-- Logs begin at Fri 2022-08-12 11:06:15 UTC, end at Fri 2022-08-12 12:16:33 UTC. -- Aug 12 11:43:18.376631 dv-cinder-852828-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 12 11:43:18.388831 dv-cinder-852828-2-smb devstack@keystone.service[81645]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 11:43:18 2022] *** Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: nodename: dv-cinder-852828-2-smb Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: machine: x86_64 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: clock source: unix Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: pcre jit disabled Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: detected number of CPU cores: 4 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: current working directory: / Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: detected binary path: /usr/bin/uwsgi-core Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: your processes number limit is 47680 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: your memory page size is 4096 bytes Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: detected max file descriptor number: 2048 Aug 12 11:43:18.391109 dv-cinder-852828-2-smb devstack@keystone.service[81645]: lock engine: pthread robust mutexes Aug 12 11:43:18.391877 dv-cinder-852828-2-smb devstack@keystone.service[81645]: thunder lock: enabled Aug 12 11:43:18.391877 dv-cinder-852828-2-smb devstack@keystone.service[81645]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 12 11:43:18.391877 dv-cinder-852828-2-smb devstack@keystone.service[81645]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 11:43:18.430163 dv-cinder-852828-2-smb devstack@keystone.service[81645]: Python main interpreter initialized at 0x5580fb5699c0 Aug 12 11:43:18.430163 dv-cinder-852828-2-smb devstack@keystone.service[81645]: python threads support enabled Aug 12 11:43:18.430163 dv-cinder-852828-2-smb devstack@keystone.service[81645]: your server socket listen backlog is limited to 100 connections Aug 12 11:43:18.430163 dv-cinder-852828-2-smb devstack@keystone.service[81645]: your mercy for graceful operations on workers is 90 seconds Aug 12 11:43:18.430504 dv-cinder-852828-2-smb devstack@keystone.service[81645]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 11:43:18.430619 dv-cinder-852828-2-smb devstack@keystone.service[81645]: *** Operational MODE: preforking *** Aug 12 11:43:18.430877 dv-cinder-852828-2-smb devstack@keystone.service[81645]: *** uWSGI is running in multiple interpreter mode *** Aug 12 11:43:18.430877 dv-cinder-852828-2-smb devstack@keystone.service[81645]: spawned uWSGI master process (pid: 81645) Aug 12 11:43:18.431080 dv-cinder-852828-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 12 11:43:18.431829 dv-cinder-852828-2-smb devstack@keystone.service[81645]: spawned uWSGI worker 1 (pid: 81657, cores: 1) Aug 12 11:43:18.431979 dv-cinder-852828-2-smb devstack@keystone.service[81645]: spawned uWSGI worker 2 (pid: 81658, cores: 1) Aug 12 11:43:18.432116 dv-cinder-852828-2-smb devstack@keystone.service[81645]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 11:43:24.001779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:43:24.001779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: from cryptography.utils import int_from_bytes Aug 12 11:43:24.002607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:43:24.002607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: from cryptography.utils import int_from_bytes Aug 12 11:43:24.003034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:43:24.003034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: from cryptography.utils import int_from_bytes Aug 12 11:43:24.003142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 11:43:24.003142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: from cryptography.utils import int_from_bytes Aug 12 11:43:24.052530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:43:24.052694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 11:43:24.052778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:43:24.052863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 11:43:24.052935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] command line args: [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:43:24.053012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] command line args: [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 11:43:24.053155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:43:24.053242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 11:43:24.053339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ================================================================================ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:43:24.053425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ================================================================================ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 11:43:24.053593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] admin_token = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.053678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] admin_token = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.053840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_dir = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.053925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_dir = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_source = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_source = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] debug = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] debug = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.054898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.055962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_config_append = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_config_append = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_dir = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_dir = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.056981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.057992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.058936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.059092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.059201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.059341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.060893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] publish_errors = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.061955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] publish_errors = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] standard_threads = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.062993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_journal = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] standard_threads = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_json = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_stderr = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_syslog = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.063985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.064133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_journal = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.064214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.064297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_json = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.064390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.064474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_stderr = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.064648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_syslog = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.064740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.064878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 11:43:24.065129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.065968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.066969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.067922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.068896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.069843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.070903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.071948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.072881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.073906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.074880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.075896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.076930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.077884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.078999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.079928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.080984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.081921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.082989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.083991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.084961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.085917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.086912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.087940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.088890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.089828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.external = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.090954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.password = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.external = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.token = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.091966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.092877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.password = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.token = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.093984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.094880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.095997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.096921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.097906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.098932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.099944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.100965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.101986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.102637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.114994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.115976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.116939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.117895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.118993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119729 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.119944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.120929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.121891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.122920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.123958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.124995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.125881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.126979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.127939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.128961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.129970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.130985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.131930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.132937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.133922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.134993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.135943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.136926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.137918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.138921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.139877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.140844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.141963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.142043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.142198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.142310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.142439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.142542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:43:24.143856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.143856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.144106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.144178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 11:43:24.144323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 11:43:24.172272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.172502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.172732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.172847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.173078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.173302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.182446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.182918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.211111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.211343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.211523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.211752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.264058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.264488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.315192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.315425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.315962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.316194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.380917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.381055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.381139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.381276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.381367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.381494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.405943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.406725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.417892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.418027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.430969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.431954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.432078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.432160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.432292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.432374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.432509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 11:43:24.449075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.449286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:43:24.449479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.449636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.449719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:43:24.449836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:43:24.450011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.450134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.450216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 11:43:24.450413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.450492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.450687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.450762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.453163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.453262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.453262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.462302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.462550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.462639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.462824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.462907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.463092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.463189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.463420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.470568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.470815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.473620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.473867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.473952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.474997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.475885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.476062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.476144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.476327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.476407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.476590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.499742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.499928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.501319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.501629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.501971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.502266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.506306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.506610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.506892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.506987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.507266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.507543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.513853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.514183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.514444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.514753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.518221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.518538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.518821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.518903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.519106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.519949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.520030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.520226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.520315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.520492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.520756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.536725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.537009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.537434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.537712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.540972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.541670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.544670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.544967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.545422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.545713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.549356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.550060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.552556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.553248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.555752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.556992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.557187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.557270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.557469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.557755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.573160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.573447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.573652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.573748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.573945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.574028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.574208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.574466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.580991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.581411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.582569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.582853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.582975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.583249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.585653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.585939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.586246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.586933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.587130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.598742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.599020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.599105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.599932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.600122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.600249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.600379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.600460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.600650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.617647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.617892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.620634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.620838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.623615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.623810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.625191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.625364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.626711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.626859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.626997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.627140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.627289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.627418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.633706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.633798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.635343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.635430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.639072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.639922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.640048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.647965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.648057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.648254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.648338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.648541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.648624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.655946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.656041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 11:43:24.656228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.656313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.656509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.656594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.656786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.656877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.657942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.658885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.659675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 11:43:24.692711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580fb5699c0 pid: 81657 (default app) Aug 12 11:43:24.695987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e48a8-fc05-4c62-928e-4e080f6bb5e2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:24.696270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e48a8-fc05-4c62-928e-4e080f6bb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:24.696392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580fb5699c0 pid: 81658 (default app) Aug 12 11:43:24.696540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e48a8-fc05-4c62-928e-4e080f6bb5e2 None None] PATH_INFO: `/v3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:24.701710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Fri Aug 12 11:43:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:33.122245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:33.122774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:33.122854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:33.127983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:33.133098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:33.133483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:33.133638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:33.203566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: INFO dbcounter [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] Registered counter for database keystone Aug 12 11:43:33.222104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG oslo_db.sqlalchemy.engines [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:43:33.228184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writer thread running {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:43:33.414676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG passlib.handlers.bcrypt [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81657) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 11:43:33.414994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG passlib.handlers.bcrypt [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81657) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 11:43:33.471745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:33.473355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:33.610247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 12 11:43:34.074506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:34.143766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: INFO dbcounter [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] Registered counter for database keystone Aug 12 11:43:34.164922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG oslo_db.sqlalchemy.engines [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 11:43:34.171652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writer thread running {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 11:43:34.287810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56effbb7-f0f3-4f22-9983-925c7eb738d5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:34.292089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:34.292706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:34.292986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:34.293254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:34.302072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:34.353679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 11:43:34.354014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2648f69-2f19-437c-b983-ed40569dbb88 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:34.363863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Aug 12 11:43:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 11:43:34.369827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:34.384070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f2c22-528d-4203-85a6-8625a71d2b95 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:34.389224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:34.390319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:34.390628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:34.390902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] PATH_INFO: `/v3/projects/65344c3d4d6c482091ff358a1b54d508` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:34.392351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] RBAC: Authorizing `identity:get_project(project_id=65344c3d4d6c482091ff358a1b54d508)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:34.442661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING keystone.common.rbac_enforcer.enforcer [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 11:43:34.443006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eeb86-9d5a-4426-880f-9e2fd0c5a4cd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:34.447660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Fri Aug 12 11:43:34 2022] GET /identity/v3/projects/65344c3d4d6c482091ff358a1b54d508 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:36.301016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d9d4-c971-49f8-8791-625065d50074 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.301620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d9d4-c971-49f8-8791-625065d50074 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.301620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2d9d4-c971-49f8-8791-625065d50074 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.305745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:36.311742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.312173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.312290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.333573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:36.335105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:36.342825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 11:43:36.611712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2d9d4-c971-49f8-8791-625065d50074 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:36.624590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2d9d4-c971-49f8-8791-625065d50074 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:36.628739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:36.629340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.629620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.629895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.637658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:36.639472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c743ad5-7618-4606-aaee-5bd039eea03f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:36.648013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Aug 12 11:43:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:43:36.653301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:36.662152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbbf77-781f-4e76-8a7c-db2bd4fb6076 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:36.666340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:36.666984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:36.667259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:36.667528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:36.669337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:36.671165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f719a8-9eac-4c92-87e0-9447849d7616 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:36.672653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Fri Aug 12 11:43:36 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:38.615061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271882c9-1690-44c3-af6f-e9645521b002 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.615590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271882c9-1690-44c3-af6f-e9645521b002 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.615590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271882c9-1690-44c3-af6f-e9645521b002 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.616914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:38.622753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.623191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.623308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.641606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:38.642796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:38.689149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac918-0c8c-42d9-9ef3-11a67088351c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.689469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac918-0c8c-42d9-9ef3-11a67088351c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.689706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac918-0c8c-42d9-9ef3-11a67088351c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.691854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:38.697503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:38.697786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:38.698064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:38.723709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:38.749106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG passlib.handlers.bcrypt [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81658) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 11:43:38.749520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG passlib.handlers.bcrypt [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81658) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 11:43:38.795034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:38.796582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:38.892368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:38.993161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.017382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.097612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a22e7-23fe-4ac5-b8b5-8a1582c210a1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.131936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.132566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.132848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.133123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.144638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:39.153280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:39.154342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:39.155405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:39.159031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.161838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.241718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.257783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ed6d9-605d-4250-81a7-77322efba04b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.259995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.260106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece0978-bd40-4178-894a-5a7538837580 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.294831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.295108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.295681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.295793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.295960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.296054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.296233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.296318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.296912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:39.297216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.298668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.316791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:39.322317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.364202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.365709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.469185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:39.474856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.478009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.533244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdc082-123c-4f8c-8490-13624a6c8e82 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.566933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.567560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.567840 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.568120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.569316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.570784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.572350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:39.577186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e76c-ad7a-479b-9bd3-98aaeaba3a43 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.578399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.594690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.614576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.615442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.616059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.616059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.635452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.637213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:43:39.655114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:39.656199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:43:39.657125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:43:39.657125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:43:39.657125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:43:39.657125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:43:39.662382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.689276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb76924-2902-4378-b447-19708f0b0c2c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.718196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.722325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.722993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.723274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.723549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.724671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.726172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.730268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:39.734153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:39.763233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bc17e-1407-44a8-b0f2-856161c2321e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.796496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.797041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.797318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.797590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.798230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:39.798550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.799925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ddcc7-9154-43bf-aa14-56699add7387 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.813978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:39.817314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:39.833371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6223d-a25a-4b56-aeb6-b0aafbf482b5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:39.870414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:39.871066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:39.871936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:39.872218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:39.872958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.domain.id=default, user.id=83657fa192a54fdc848106558d0816ba) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:39.873264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:39.874759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41de76-6f14-4d1e-af3c-7660dcee84b8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:39.882191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Aug 12 11:43:39 2022] GET /identity/v3/role_assignments?user.id=83657fa192a54fdc848106558d0816ba&scope.domain.id=default&role.id=5540f9b1011544929fd18ae216a070b0 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:42.098430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4345d66-b1e6-43c9-b34e-26df5f52cece None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.098957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4345d66-b1e6-43c9-b34e-26df5f52cece None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.099031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4345d66-b1e6-43c9-b34e-26df5f52cece None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.100485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:42.105745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fdbd-cd5b-487d-9185-370f81b903f3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.106138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fdbd-cd5b-487d-9185-370f81b903f3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.106330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fdbd-cd5b-487d-9185-370f81b903f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.130031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e6d9fdbd-cd5b-487d-9185-370f81b903f3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:42.131273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e6d9fdbd-cd5b-487d-9185-370f81b903f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:42.210603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:42.309924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5943-cef8-4245-bfc8-8497a9ac5c95 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.310209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5943-cef8-4245-bfc8-8497a9ac5c95 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.310486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5943-cef8-4245-bfc8-8497a9ac5c95 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.312105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:42.317087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592deaa-2d42-4163-9cfb-d094229a1469 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.317549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592deaa-2d42-4163-9cfb-d094229a1469 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.317971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592deaa-2d42-4163-9cfb-d094229a1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.345598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e592deaa-2d42-4163-9cfb-d094229a1469 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:42.347070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e592deaa-2d42-4163-9cfb-d094229a1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:42.428397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc288-2049-43d8-bb24-885ae89fbce0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.428568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc288-2049-43d8-bb24-885ae89fbce0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.428848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cc288-2049-43d8-bb24-885ae89fbce0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.430502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 13/25] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:42.431643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:42.451151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.451432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.451705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.463013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe347-d1ac-4bb2-83d8-490934b42107 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.463573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe347-d1ac-4bb2-83d8-490934b42107 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.463998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe347-d1ac-4bb2-83d8-490934b42107 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.465800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:42.483486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:42.484635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.484762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:42.485187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.485600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.510180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:42.516504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:42.517955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:42.628005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:42.628869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:42.629498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 14/29] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:42.756660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38329025-cb4d-4aa1-98a3-2ff747cd83fd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:42.799406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:42.800048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:42.800328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:42.800601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:42.802416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:42.818936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:42.828022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:42.828855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:42.829616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 16/30] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:42.836161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:42.902762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:42.914955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:42.970834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f71794-a244-4a12-9809-27a9233825eb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.006356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.007075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.007298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.007582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.008242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:43.008543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.009928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.106463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13df8c0-7764-4acf-aef1-839c911e4654 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.131289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:43.132061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.163210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.163830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.164111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.164384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.165148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.166669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.240041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cf0d9-fc94-47fa-8795-3476b5f15c7e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.250631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.286590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.286590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.286590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.286590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.286948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.286948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.375372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 17/32] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Aug 12 11:43:42 2022] POST /identity/v3/roles => generated 219 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:43:43.376260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.475622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.503947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 16/33] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Aug 12 11:43:43 2022] POST /identity/v3/roles => generated 225 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:43:43.505136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.614739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b48add-20dc-4fad-9023-441e1f88ea70 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.702356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.705198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.705499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.705778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.707674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.711885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.713345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ae61-44a0-416e-9ae6-2e28a04a37dd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.716939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 18/34] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:43 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:43.722343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.764063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.765826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.766143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.766430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.778229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.780101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a751278b-a3ce-4044-9cb9-09cc470fb479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:43:43.797084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:43.798060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:43:43.798918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:43:43.798918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:43:43.798918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:43:43.798918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 17/35] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:43.800204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d3c1-5463-408a-bb20-c82c93f45297 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.800470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d3c1-5463-408a-bb20-c82c93f45297 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.800950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37d3c1-5463-408a-bb20-c82c93f45297 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.802687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:43.812042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.812497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.812784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.835396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:43.836884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:43.851850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.869625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562b4f-bae1-4b5d-94d2-0aa2ae888d5a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:43.893444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:43.904661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:43.905291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.905571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.905845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.906273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:43.907128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:43.907244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:43.908655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050903d-37cd-4541-a4db-633fc827ecb1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:43.910221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:43.911441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfa1c-81eb-48dc-8646-00475e3b0bdc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:43.911728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfa1c-81eb-48dc-8646-00475e3b0bdc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:43.912005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfa1c-81eb-48dc-8646-00475e3b0bdc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:43.913188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:43.915868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfa1c-81eb-48dc-8646-00475e3b0bdc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.014118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad6a66-7984-41b3-8ab2-a1cedad1835c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.024075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfa1c-81eb-48dc-8646-00475e3b0bdc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.049484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.050111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.050394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.050700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.051460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:44.051993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.054541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ab46d-2f59-4b51-84c5-b9536721d97c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.061614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.062570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.063049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.063498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] PATH_INFO: `/v3/domains/default/users/83657fa192a54fdc848106558d0816ba/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.065859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=83657fa192a54fdc848106558d0816ba, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.067604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.069347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 20/40] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:44.070600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.070888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.071164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.088643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:44.090413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:44.093198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.157065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 21/41] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:44.158579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.178552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1361 bytes} [Fri Aug 12 11:43:43 2022] PUT /identity/v3/domains/default/users/83657fa192a54fdc848106558d0816ba/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:43:44.188415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.249528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.309946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e83f1-d688-42f1-8275-331f682d4b2c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.327423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f597bb-aa8a-463e-8243-32edafc3f6c3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.356797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.357746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.358329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.358821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.359943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.361411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.373974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.377231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.377909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.378189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.378460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.379987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.381070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.386626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:44.389737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.500042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2148-4a4c-435b-ba24-b0c7016950ee None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.513909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:43:44 2022] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:43:44.514872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:44.533146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:44.553975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.554901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.555193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.555478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.556155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.557861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3facaf5-4124-4298-b522-727ab2c78d29 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.641045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626173-747a-452c-9ac4-5f8ca4b2aa69 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:44.651755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:43:44 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:43:44.690779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:44.691418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:44.691698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:44.691970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:44.692703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:44.694101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69baef-9757-4d0e-8ff0-5477eb7859f8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:44.760843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Aug 12 11:43:44 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:43:46.134336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fc448-2786-4a48-9e8a-23d0d5e01fa3 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.134874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fc448-2786-4a48-9e8a-23d0d5e01fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.134959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fc448-2786-4a48-9e8a-23d0d5e01fa3 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.136249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:46.142367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3005c-5ec5-4441-b2f4-e202cfd2ee88 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.142800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3005c-5ec5-4441-b2f4-e202cfd2ee88 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.142962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3005c-5ec5-4441-b2f4-e202cfd2ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.160194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a3f3005c-5ec5-4441-b2f4-e202cfd2ee88 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:46.161370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a3f3005c-5ec5-4441-b2f4-e202cfd2ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:46.206727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:46.225673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:46.492305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fc448-2786-4a48-9e8a-23d0d5e01fa3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:46.588624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0251f-e96b-4682-9f6f-3839e2853557 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.588912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0251f-e96b-4682-9f6f-3839e2853557 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.589195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0251f-e96b-4682-9f6f-3839e2853557 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.590603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 25/49] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:46.592158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fc448-2786-4a48-9e8a-23d0d5e01fa3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:46.595321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.595617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.595897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.613426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:46.614647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:46.626692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:46.627319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.627603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.627878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.638031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:46.642749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:46.643584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:46.644337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:46.649455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:46.679241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:46.681943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 26/51] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:46.748214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3643c-b400-4743-accd-8f0724f096a6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:46.781299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:46.781895 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.782175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.782446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.783132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:46.783431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:46.784808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:46.792550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:46.798797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:46.892333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8944f4-915a-4542-ab28-e738a7040730 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:46.905228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:46.925405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:46.926033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:46.926309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:46.926613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:46.927933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:46.929511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:46.931385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:46.936871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:46.948267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:47.026746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:47.036170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85519add-e05e-45ec-a039-0c993f660aee None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:47.046479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b56b-293e-4ccc-bbdb-c13f56980c7c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:47.069484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:47.070112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:47.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:47.070693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:47.071799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:47.073214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:47.074856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:47.079219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:47.079994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:47.080275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:47.080523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:47.080612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:47.081632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:47.083091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:47.084639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:47.090416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:47.138085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:47.178312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb1067-8359-4334-a101-38c3e5759d58 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:47.188065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917047f0-9498-42fc-82fd-db63f7fbb2c0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:47.211393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:47.211987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:47.212270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:47.212545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:47.213269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.domain.id=default, user.id=83657fa192a54fdc848106558d0816ba) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:47.213635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:47.215774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4713a-85ec-437e-807d-3c390076f0ae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:47.221531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:47.221661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Aug 12 11:43:47 2022] GET /identity/v3/role_assignments?user.id=83657fa192a54fdc848106558d0816ba&scope.domain.id=default&role.id=5540f9b1011544929fd18ae216a070b0 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:47.221878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:47.222163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:47.222444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:47.223116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:47.224579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b6ef4-f756-4cd8-8459-d3d50a62bd6e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:47.314873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 29/57] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Aug 12 11:43:47 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:43:49.232057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e371-9bf2-44f4-8b3f-30bba51162aa None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:49.232573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e371-9bf2-44f4-8b3f-30bba51162aa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:49.232679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e371-9bf2-44f4-8b3f-30bba51162aa None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:49.233937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:49.239095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:49.239503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:49.239650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:49.257413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:49.258701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:49.322934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:49.593600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e371-9bf2-44f4-8b3f-30bba51162aa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:49.618702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:49.696096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e371-9bf2-44f4-8b3f-30bba51162aa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:49.727915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:49.728537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:49.728817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:49.729090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:49.730937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:49.733376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a74370-df92-48cf-b79e-3978b4e69b45 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:49.736264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:49.741564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:49.770444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:49.836201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a73c48-89d0-4c49-837f-4c36b1f14705 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:49.869036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:49.869584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:49.869864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:49.870134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:49.870803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:49.872227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c61cc-8ff3-4d4c-a9c7-7f2c3873c8a3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:49.966489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:43:49 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:43:52.929424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa741e5-9d8a-470f-9d6c-3425f25074ca None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:52.930458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa741e5-9d8a-470f-9d6c-3425f25074ca None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:52.930981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa741e5-9d8a-470f-9d6c-3425f25074ca None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:52.932537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:52.938157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efccb2-5054-4f94-93fb-a3aa938f0eb9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:52.939042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efccb2-5054-4f94-93fb-a3aa938f0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:52.939520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efccb2-5054-4f94-93fb-a3aa938f0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:52.962498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-64efccb2-5054-4f94-93fb-a3aa938f0eb9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:52.964040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-64efccb2-5054-4f94-93fb-a3aa938f0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:53.056812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:53.177699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6c9c-c3a5-44a1-865c-34e64a8d4ebc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.178320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6c9c-c3a5-44a1-865c-34e64a8d4ebc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.178843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6c9c-c3a5-44a1-865c-34e64a8d4ebc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.180720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:53.185684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f7b2-816d-4ecd-b3db-39fce89643ef None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.185978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f7b2-816d-4ecd-b3db-39fce89643ef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.186262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f7b2-816d-4ecd-b3db-39fce89643ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.211484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a0d2f7b2-816d-4ecd-b3db-39fce89643ef None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:53.212698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a0d2f7b2-816d-4ecd-b3db-39fce89643ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:53.224184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:53.292754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:53.420242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea4ed-30c8-41c7-b700-abd99573ed57 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.420858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea4ed-30c8-41c7-b700-abd99573ed57 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.421297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea4ed-30c8-41c7-b700-abd99573ed57 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.422831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 33/66] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:53.428290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfce7-c5c0-4c4c-8a6a-ccfcc89d121c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.428582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfce7-c5c0-4c4c-8a6a-ccfcc89d121c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.428868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfce7-c5c0-4c4c-8a6a-ccfcc89d121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.450538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bdbac-6833-43d8-bf16-8ea428a33f7d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.450538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bdbac-6833-43d8-bf16-8ea428a33f7d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.450538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bdbac-6833-43d8-bf16-8ea428a33f7d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.455649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f48bfce7-c5c0-4c4c-8a6a-ccfcc89d121c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:53.456875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f48bfce7-c5c0-4c4c-8a6a-ccfcc89d121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:53.457590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 34/67] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:53.467231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370fe08-4486-4452-a6d5-e968618e43c4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.467801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370fe08-4486-4452-a6d5-e968618e43c4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.468914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370fe08-4486-4452-a6d5-e968618e43c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.489599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7370fe08-4486-4452-a6d5-e968618e43c4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:53.491628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7370fe08-4486-4452-a6d5-e968618e43c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:53.536625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:53.537887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399cf81-ace5-4885-9d17-1c4d045cfe1a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.538178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399cf81-ace5-4885-9d17-1c4d045cfe1a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.538457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399cf81-ace5-4885-9d17-1c4d045cfe1a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.539801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 35/69] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:53.540639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399cf81-ace5-4885-9d17-1c4d045cfe1a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:53.572873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:43:53.575015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.575463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.575878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.609643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:53.611231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:53.645189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:53.661509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:53.687624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399cf81-ace5-4885-9d17-1c4d045cfe1a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:53.716802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:53.724005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:53.735439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:53.742538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.742538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.742538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.752265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:53.759640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:53.760485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:53.762061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:43:53.766055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:53.768334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:53.876925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8372-3a34-4ef8-8d30-db55b1c548bf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:53.877500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401bfd2-382f-4242-9ba6-7789ccbaf1f8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:53.911146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:53.911542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:53.911756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.912043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.912196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:53.912342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.912427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:53.912697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:53.912990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:53.913297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:53.914743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:53.917037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:53.924333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:53.930982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:53.931101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:53.933139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:53.934478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:43:53.935269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:53.935851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:43:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:53.936415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:53.951309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.043766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eef0d-d0a3-47a8-ade9-7c56aeb4a603 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.047909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605b57-b4d7-4059-9c0d-42c186e68dda None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.079027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.079662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.079949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.080238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.081611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.082231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.082508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.082810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.083910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.085582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.087412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.088261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.092963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:54.098124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:54.099094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:54.103391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.156595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.170338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.188975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebad31-9183-4741-b194-104277cec234 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.196511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7795-8bf2-4f3c-93c3-052ca443f4fa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.221282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.221914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.222190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.222477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.229824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.230698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.230976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.231245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.231902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:54.232202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.233579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.236392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.237847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.239499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.240261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.241411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.241411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.354648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8800ff-e2c8-4f50-8e5b-b78fe38c4752 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.355833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7ba91-da48-4639-8fe6-033315296d1f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.374768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.387607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.394132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.394400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.394508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.394508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.394695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.394695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.394695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.394695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.394695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.396230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.399975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:54.405152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:54.406014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:54.406820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:54.407571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.474990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 40/80] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:43:54 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:43:54.478956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.512351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bbe7-260e-4ad1-b4b7-006be4bc7fe6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.553502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.554247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.554621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.554827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.555512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:54.555814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.557294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.571922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.571922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.593926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be10d3-8553-4a37-995c-f0dddd54e222 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.634559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.635156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.635451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.635878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.642340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.689680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e167d6-9823-4477-a468-b8103107e0ee None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.693049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.724639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.726251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.728523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.729158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.729424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.729691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.731475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.733377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.735058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 42/82] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.735850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.863366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 41/83] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:54.863552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744618b-4e2b-4b24-ba90-dce0c6b0832f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:54.865056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.894957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.901675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:54.903218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:54.903824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:54.909407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:54.909407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:54.909407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:54.909407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:54.918716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 43/84] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:54.919870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:54.958030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:54.982928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0113c-c25c-43d5-8a10-cc63849e02bb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.021449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.022098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.022384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.022714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.023401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63010e74-05cd-4bbd-bae8-ec2eeb454d0e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.023898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.025384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.028578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:55.029356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.073264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.073264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.073264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.073264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.146195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034dcb9-8068-437d-a729-7e43c5d70204 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.155092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.168758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.170713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.182658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.183420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.183765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.184107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.185375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.188103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.194959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:55.195938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.238924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.273744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 44/87] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:55.274391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.304350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a437ed3-5e34-4f3a-bd49-a5251feace9d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.346001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.346844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.347294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.347641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.348965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.350722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.352439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:55.353303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.384313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.391135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bbfc-e0c9-4acf-a005-8096e8bc0bf1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.425555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.426264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.426945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.427571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.445654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.468614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74f18a-4fb9-4f76-96b4-3466c7cb58c8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.507170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997886-72a2-40cc-a584-38544f7999db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.507372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.508167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997886-72a2-40cc-a584-38544f7999db None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.508593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997886-72a2-40cc-a584-38544f7999db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.509077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997886-72a2-40cc-a584-38544f7999db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.509219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.510070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997886-72a2-40cc-a584-38544f7999db None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:55.510540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997886-72a2-40cc-a584-38544f7999db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.513097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997886-72a2-40cc-a584-38544f7999db None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.522381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:55.531886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997886-72a2-40cc-a584-38544f7999db None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.617494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.626155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:55.627047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.762559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997886-72a2-40cc-a584-38544f7999db None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.830348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.831024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.831310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.831589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.835788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:55.837255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:55.839089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:55.839938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:55.844490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b09e1-2ef7-4b2f-b4d2-f2419af47ed3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.860203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.925175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:55.925793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:55.926076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:55.926353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:55.976793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f386a-ab99-4592-91c3-77c5079077b2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:55.988295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:55.999847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.001392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.015204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:56.016314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.016799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.017259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] PATH_INFO: `/v3/projects/3785717310a24dc7b665b40d6c9acc51` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.018616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] RBAC: Authorizing `identity:get_project(project_id=3785717310a24dc7b665b40d6c9acc51)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.020247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.022134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/projects/3785717310a24dc7b665b40d6c9acc51 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:56.023133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:56.116605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:56.137400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0612e-2aa2-400b-8b98-47bf354f4c8f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:56.175242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:56.176640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.177133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.177593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.178503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:56.179032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.180668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.187240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 48/93] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:43:56 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:56.188461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:56.216021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 46/94] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:56.222142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:56.301211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc197-d282-4f59-ae97-b13c7bff2743 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:56.346784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:56.347750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.348254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.348742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.349692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=3785717310a24dc7b665b40d6c9acc51, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:56.350229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.351933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.358322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 49/95] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:43:56 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=3785717310a24dc7b665b40d6c9acc51&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:56.414159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:56.430460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aa2b7-f763-40d1-9d98-69325db631f1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:56.493215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:56.493870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.494154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.494428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.496577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.498059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3cfce-3d97-42dc-bfb6-4269f5ce04b7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.499773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 47/96] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:56 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:56.505927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:56.519232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:56.632097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd679-e979-437b-9994-9244e6cb123e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:56.677778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:56.678454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.678696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.678976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.679708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=83657fa192a54fdc848106558d0816ba) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:56.680021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:56.681455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d3a0-b3aa-40c5-95a4-d6c3d144ff80 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:56.690768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 50/97] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:43:56 2022] GET /identity/v3/role_assignments?user.id=83657fa192a54fdc848106558d0816ba&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:56.787549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af662b-90b2-4fc6-bbd7-cdaad3565782 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.787884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af662b-90b2-4fc6-bbd7-cdaad3565782 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.788116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af662b-90b2-4fc6-bbd7-cdaad3565782 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.789470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 48/98] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:56.795098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.795397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.795679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.819953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:56.821177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:56.905147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8f93-7e14-42e1-9dea-0fd3c990a01d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.905445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8f93-7e14-42e1-9dea-0fd3c990a01d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.905631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed8f93-7e14-42e1-9dea-0fd3c990a01d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.907050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 49/99] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:56.909606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 51/100] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:56.925864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:56.926158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:56.926429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:56.955548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:56.956782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:57.045580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 50/101] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:57.381443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:57.383654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:57.517207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e7e84-ec3c-439c-bbd8-2a5080a84042 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:57.565061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:57.565706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:57.565988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:57.566262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:57.567407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:57.568854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:57.570765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 52/102] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:57.576455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:57.609568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:57.727799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:57.775455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a545b66-74c6-4935-805e-8d7a36631c6f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:57.785187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:57.809674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72ed99-01fd-4729-bb94-d6f558f09979 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:57.836944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:57.837590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:57.837869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:57.838141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:57.867189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:57.873480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:57.874300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:43:57.875112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:43:57.878410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 53/103] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:43:57.887322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:57.911136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:57.911761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:57.912041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:57.912318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:57.912975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:57.914477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:58.051450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 51/104] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:43:57 2022] POST /identity/v3/projects => generated 302 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:43:58.066851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cfd7c-b20a-4146-945a-251dd3aa4853 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:58.108931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:58.118327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:58.119081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.119375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.119651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.120332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:58.121184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:58.122604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235beec-c5bd-4087-8121-cc6a06e25b9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:58.132556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:43:58.138908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:58.301940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef554a-6974-48ef-a24b-4ff6edfc7c63 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:58.324371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411498d-5ec7-41fc-a89f-d53892a39131 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.324694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411498d-5ec7-41fc-a89f-d53892a39131 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.324934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411498d-5ec7-41fc-a89f-d53892a39131 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.326307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 55/106] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:43:58.331879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.332168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.332447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.353556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:58.355353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:58.381506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:58.382153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.382436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.382741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] PATH_INFO: `/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.401259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:58.409006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=99a8723fd9ea4ae0a4e680e5cd3f9977)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:58.410489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:58.412225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 52/107] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:58 2022] GET /identity/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:58.419320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:58.493698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 56/108] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:58.553419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5547-f995-4d94-a9b5-575b47899fd4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:58.588622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575662c8-2060-4b21-b117-9de829094dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:58.589905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575662c8-2060-4b21-b117-9de829094dec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.590078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575662c8-2060-4b21-b117-9de829094dec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.590333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575662c8-2060-4b21-b117-9de829094dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.657045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:58.667096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575662c8-2060-4b21-b117-9de829094dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:58.668619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575662c8-2060-4b21-b117-9de829094dec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:58.779197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 53/109] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:43:58.784479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:58.937592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575662c8-2060-4b21-b117-9de829094dec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:58.939259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307fed7-d465-4c9a-bd48-461a6b499398 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:58.972190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:58.990559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:58.991216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:58.991501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:58.991778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:58.993600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:58.995198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:58.997471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 57/110] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:58 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:59.004381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:59.160184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:59.164562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575662c8-2060-4b21-b117-9de829094dec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:59.205299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedffa1f-38b1-4cec-a908-2c17ec3340bd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:59.228919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:59.230372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.230863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.231270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.243336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-045eccdf-8841-4435-b086-ecc165e6f476 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:43:59.248682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:43:59.249632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:43:59.250647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:43:59.252585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:43:59.253959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085eb13-bd8c-4a04-93ed-aedfd1bcac84 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.254438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085eb13-bd8c-4a04-93ed-aedfd1bcac84 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.254818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:59.255190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085eb13-bd8c-4a04-93ed-aedfd1bcac84 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.255431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.255712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.255989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.256712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=99a8723fd9ea4ae0a4e680e5cd3f9977) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:59.257019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:59.257899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 55/112] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:59.258451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:59.263683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc109-f43d-4772-a6e9-ee7816b1a9cd None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.264267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc109-f43d-4772-a6e9-ee7816b1a9cd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.264738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc109-f43d-4772-a6e9-ee7816b1a9cd None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.265093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 58/113] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:43:59 2022] GET /identity/v3/role_assignments?user.id=99a8723fd9ea4ae0a4e680e5cd3f9977&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:59.265725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:59.266823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 56/114] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:59.268091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.268588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.269051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.342805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:59.344364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:59.355905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:59.406544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068226-478a-4ce7-8024-bea1932fb80b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:59.439510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:59.439986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.440265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.440544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.441218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:43:59.441523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:59.442948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792dbd3-3073-423a-95a4-0b9352292b74 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:59.466808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 59/115] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:59.468017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70fe31-23d1-4ac3-b816-9a066e7b9d59 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.468305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70fe31-23d1-4ac3-b816-9a066e7b9d59 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.468582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70fe31-23d1-4ac3-b816-9a066e7b9d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.476670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 57/116] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:59.477670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:59.507373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cc70fe31-23d1-4ac3-b816-9a066e7b9d59 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:59.508587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cc70fe31-23d1-4ac3-b816-9a066e7b9d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:59.613232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 60/117] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:59.614568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d911-ec52-4639-a4b1-491dc1cd2c29 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.614793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d911-ec52-4639-a4b1-491dc1cd2c29 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.615066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5d911-ec52-4639-a4b1-491dc1cd2c29 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.616438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 61/118] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:43:59.623766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.624046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.624317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.648038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:43:59.655308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:43:59.665206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:59.692466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cec02-0ebc-483f-8fb7-b266971833f0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:59.699994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:43:59.741919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 62/119] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:43:59.762505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173910-65ae-4969-b734-93b770693102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:59.763411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173910-65ae-4969-b734-93b770693102 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.763827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173910-65ae-4969-b734-93b770693102 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.764232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173910-65ae-4969-b734-93b770693102 None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.765509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173910-65ae-4969-b734-93b770693102 None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:59.767195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173910-65ae-4969-b734-93b770693102 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:59.768933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:43:59 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:59.774770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:59.918101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8874f-c90e-4958-9bd3-db461a58c542 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:43:59.964773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173910-65ae-4969-b734-93b770693102 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:43:59.967751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:43:59.968597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:43:59.968883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:43:59.969155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:43:59.971153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:43:59.972595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:43:59.974368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:43:59 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:43:59.979971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.045335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.130435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6e41-f397-49ff-b095-b06756cf6efc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.170171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.170171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.170171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.170171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/users/d489e73bfdd74cd59722698ff230be22/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.170632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, user_id=d489e73bfdd74cd59722698ff230be22, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:00.172109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:00.177564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173910-65ae-4969-b734-93b770693102 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.212559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.213200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.213482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.213755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.224776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:00.229772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:00.230978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 59/122] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:00.231841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.241916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 64/123] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:43:59 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/users/d489e73bfdd74cd59722698ff230be22/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:00.243220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.256296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.375114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884720b5-73c9-4fc0-aac4-e5074841d6d3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.378905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.421825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.422888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.423363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.423824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.428787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492f306-e9ba-4eb4-8b40-0d94139cfaf8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.436852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:00.442078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:00.443017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:00.443805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:00.445968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 65/124] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:00.446912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.505899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.506554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.506846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.507122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.532957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:00.538332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:00.539391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:00.540301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:00.545947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 60/125] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:00.547900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.609045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81103b-fb29-4b04-80a3-61c3ff93fa53 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.675802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.691821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.694939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.694939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.694939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.694939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:00.694939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:00.695394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:00.699155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147119-57f7-49bd-ad7d-1524761dbdf6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.716408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 66/126] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:00.717344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.736976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.737588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.737871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.738141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.738843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:00.739145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:00.741040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:00.750982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 61/127] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:00.751931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.777735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:00.898983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaef6-d1a8-45fc-88fb-ddb7d7f0cb07 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:00.940940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:00.941482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:00.941761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:00.942039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:00.943434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:00.943750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:00.945369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:00.954249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:00.958592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:00.961274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f0a6-582a-441f-9554-d2285f52c7dd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.004369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.005383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.006293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.006798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.008836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.011537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952ba2-15bb-415f-bc0e-0c1379f9862c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.014233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.016007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a77b6-e438-4e61-b331-4184cc4ecd0b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.016454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a77b6-e438-4e61-b331-4184cc4ecd0b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.016870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a77b6-e438-4e61-b331-4184cc4ecd0b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.018883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 63/130] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:01.023354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a77b6-e438-4e61-b331-4184cc4ecd0b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.035791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.075485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.091849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262649ca-1a4a-436a-b6c4-be9070fa346c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.132355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a77b6-e438-4e61-b331-4184cc4ecd0b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.140502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.141902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.142380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.142944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.145206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.147440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.154916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 68/131] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:00 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.155978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.171464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db936-011b-4548-9800-962d006dbfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.172100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db936-011b-4548-9800-962d006dbfee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.172383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db936-011b-4548-9800-962d006dbfee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.172661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db936-011b-4548-9800-962d006dbfee None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.173798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526db936-011b-4548-9800-962d006dbfee None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.175318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526db936-011b-4548-9800-962d006dbfee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.181309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 64/132] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:01 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.181309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.181309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.181309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.197562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:01.198770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:01.269258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f3ffb-aabb-4b70-ae75-fcfe2a51b752 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.270073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 65/133] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:01.274569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.274569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.339835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.340488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.340773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.341049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.342338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.343861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.345728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 69/134] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:01 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.346318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.379060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9223d72-1463-458c-9689-303fd04d02d1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.394263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.428591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.429353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.429637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.429911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.431955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.434249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.438722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 66/135] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:01 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.440320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.534585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.564943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d996c-940a-4810-b091-327a3d3baafc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.566186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24686ead-1be5-42eb-ab41-d73af788f0b1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.601936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.602630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.602913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.603189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/users/d489e73bfdd74cd59722698ff230be22/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.605387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, user_id=d489e73bfdd74cd59722698ff230be22, role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.607008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.635103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.636320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.636686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.636966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] PATH_INFO: `/v3/projects/3785717310a24dc7b665b40d6c9acc51` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.638101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] RBAC: Authorizing `identity:get_project(project_id=3785717310a24dc7b665b40d6c9acc51)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.639890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.641530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 70/136] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:01 2022] GET /identity/v3/projects/3785717310a24dc7b665b40d6c9acc51 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:01.642633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.734669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.741077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 67/137] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:01 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/users/d489e73bfdd74cd59722698ff230be22/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:01.741737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.744026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a23cca-eb2f-4972-8e58-9b989de5b522 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.788729 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.789443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.789728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.790003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/users/83657fa192a54fdc848106558d0816ba/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.792368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, user_id=83657fa192a54fdc848106558d0816ba, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.793995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1ce4c-b4e6-464b-b1ed-ae02702c0da5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:01.865516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 71/138] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:01 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/users/83657fa192a54fdc848106558d0816ba/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:01.867665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251bcb-1db2-41b0-8b58-57108fff65d5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.868118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251bcb-1db2-41b0-8b58-57108fff65d5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.868531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251bcb-1db2-41b0-8b58-57108fff65d5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.870905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 72/139] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:01.875487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e251bcb-1db2-41b0-8b58-57108fff65d5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:01.881859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20f493-905e-4b50-bae2-29ef726e3361 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:01.921099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:01.926478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:01.927244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:01.927523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:01.931847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] PATH_INFO: `/v3/projects/3785717310a24dc7b665b40d6c9acc51/users/d489e73bfdd74cd59722698ff230be22/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:01.931847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] RBAC: Authorizing `identity:create_grant(project_id=3785717310a24dc7b665b40d6c9acc51, user_id=d489e73bfdd74cd59722698ff230be22, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:01.931847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5024be8-43d8-406a-9c0d-6bcbc466b54d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:02.005120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 68/140] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:01 2022] PUT /identity/v3/projects/3785717310a24dc7b665b40d6c9acc51/users/d489e73bfdd74cd59722698ff230be22/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:02.006392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.006706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.007005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.031927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e251bcb-1db2-41b0-8b58-57108fff65d5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:02.043032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:02.044301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:02.090853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:02.092010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.092489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.092959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.094383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:02.097579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:02.100033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 73/141] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:02.106036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:02.132879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:02.143893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:02.258887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb65e-0c44-40dd-8bc3-2dff433900eb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:02.304775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:02.305747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.306275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.306898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.308359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:02.310046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:02.426975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 74/143] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:02 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:44:02.537897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:02.660297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8fb9c-f061-48c6-b110-6076e4ae9454 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:02.686305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:02.699903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:02.700893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.701388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.701820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.718785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e8ef333a-f357-45ff-80be-666b9bc8eb31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:02.723877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:02.724875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:02.725680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:02.728004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 70/144] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:02.736872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:02.814941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7c09-fe05-4c8d-9969-82b7a940254e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.816252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7c09-fe05-4c8d-9969-82b7a940254e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.817022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7c09-fe05-4c8d-9969-82b7a940254e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.818886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 71/145] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:02.828161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.828461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.828708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.866648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:02.867833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:02.890972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:02.934904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65419924-d3d8-4c54-879a-14c2ed7ddea6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:02.976061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 72/146] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:02.993946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:02.994586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:02.994863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:02.995158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:02.995833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:02.996132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:02.997499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.006316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 75/147] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:03.012349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.132187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d7145-bead-4fcc-969e-f973a2957377 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.147559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:03.177147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.177802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.178131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.178409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] PATH_INFO: `/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.180673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=99a8723fd9ea4ae0a4e680e5cd3f9977)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:03.182148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.183794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 73/148] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:03 2022] GET /identity/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:03.189279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.326330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab8a7-a0a0-4497-9a77-cd4452fdbf44 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.368824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.369464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.369739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.370009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.371757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:03.373210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.375187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 76/149] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:03 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:03.381292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.466893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.486921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:03.585710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685b85-9d43-47f6-b025-cbc209b70dd3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.631765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773a0d-f166-4429-a2dc-932b83a5b0ce None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.669363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.669998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.670279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.670575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.682221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:03.688018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:03.688959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:03.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:03.694761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.694942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.695464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.695753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.696092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/users/99a8723fd9ea4ae0a4e680e5cd3f9977/roles/a18f90993c7f4f12a0ae9c6f37328264` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.706373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, user_id=99a8723fd9ea4ae0a4e680e5cd3f9977, role_id=a18f90993c7f4f12a0ae9c6f37328264)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:03.707844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.770925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:03.799370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 74/151] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:03 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/users/99a8723fd9ea4ae0a4e680e5cd3f9977/roles/a18f90993c7f4f12a0ae9c6f37328264 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:03.820963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5594-3bd4-461f-86cd-7cf7daf4f8dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:03.874191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:03.874897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:03.875185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:03.875452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:03.876123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:03.876419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:03.877846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:03.887240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:03.893113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:03.944486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:04.005909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054201e5-70a4-4a52-95a3-89af5f8e05f2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:04.050598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:04.051165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.051442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.051712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.052878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:04.054421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:04.056297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 75/153] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:03 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:04.061943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:04.189465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fe5-a93c-40ca-87a1-e7f01cce37cb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:04.217512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:04.227807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:04.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.228789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.229056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.301451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:04.302857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb89f6-b5b3-4e03-8c2c-f510aabccc22 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:04.405931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 79/154] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:04.411665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:04.495768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196b2c-45c0-4f45-a5c1-8627364ce137 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.496420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196b2c-45c0-4f45-a5c1-8627364ce137 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.496918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196b2c-45c0-4f45-a5c1-8627364ce137 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.498565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 80/155] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:04.505377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6e6e-9604-4d47-a73e-b5205156bef8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.505936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6e6e-9604-4d47-a73e-b5205156bef8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.506406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b6e6e-9604-4d47-a73e-b5205156bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.537461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8d2b6e6e-9604-4d47-a73e-b5205156bef8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:04.540412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8d2b6e6e-9604-4d47-a73e-b5205156bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:04.567947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97912eb0-a69c-43f9-bc02-8f79aafac1ac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:04.570122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:04.579577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:04.607467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:04.608108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.608391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.608663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.610309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:04.612293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:04.614396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 76/156] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:04 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:04.620880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:04.699911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 81/157] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:04.701534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3eda-10f7-4a0d-ae65-c34742604b8e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.702017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3eda-10f7-4a0d-ae65-c34742604b8e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.702581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3eda-10f7-4a0d-ae65-c34742604b8e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.704023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 82/158] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:04.713708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.714845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.715316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.754812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:04.757229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:04.762281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9270-bf45-437a-8f39-85fb977934db None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:04.814552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:04.815302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:04.815592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:04.815869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:04.816612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:04.816920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:04.818728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:04.829551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 77/159] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:04 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:04.912227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 83/160] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:05.214577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.268880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:05.329707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d0468-837a-433c-a4b8-3abbbfbcf803 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:05.365147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:05.365778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.366063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.366335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.377391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:05.382617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:05.383504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:05.384362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 78/161] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:05.391678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.464105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.549974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:05.584793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9876f82-0003-4a54-8c44-d103c16108ca None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:05.592934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5be85-c8ee-4cfd-9779-c4cdc63d3f96 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:05.600517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:05.631898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:05.632530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.632809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.633075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.645106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a2000663-62b6-4107-9edb-f32afbe0005c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:05.650847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:05.652257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:05.653027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 79/162] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:05.654397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1608-6631-4c2f-b58c-586f0e4e9bd4 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.654397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1608-6631-4c2f-b58c-586f0e4e9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.654397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f1608-6631-4c2f-b58c-586f0e4e9bd4 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.655991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 80/163] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:05.659774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:05.660323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1608-6631-4c2f-b58c-586f0e4e9bd4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.660446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.660675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.661051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.661738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:05.662044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:05.663509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae085-334d-4c7a-b79b-151d28b255c3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:05.681386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 84/164] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:05.682664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.682955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.683233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.717332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:05.718599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:05.827990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f1608-6631-4c2f-b58c-586f0e4e9bd4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:05.900765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:05.902250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.906789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:05.907649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:05.908128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:05.908625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:05.909491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:05.909985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:05.911616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:05.930817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 81/166] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:05.935894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:05.993198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.028167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.056695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d11886-6b4e-47aa-a394-e765e13ad9dd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.116075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.117011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.117521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.117959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.119282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:06.120944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:06.122751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 86/167] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:06.127919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93295102-d09f-4e93-a3c6-f0a2fa9e8eaf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.128522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.178060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.178751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.179029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.179299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] PATH_INFO: `/v3/users/83657fa192a54fdc848106558d0816ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.183300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] RBAC: Authorizing `identity:get_user(user_id=83657fa192a54fdc848106558d0816ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:06.184772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:06.186386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 82/168] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:05 2022] GET /identity/v3/users/83657fa192a54fdc848106558d0816ba => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:06.192054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.272722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a12-4dcb-454a-9028-74bf85f95416 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.353556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.356262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.356787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.358133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.373791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.389897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaef7-9e24-4b92-b1e3-21c7cf9f60a2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.394203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.453254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.454270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.454978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.456104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.477567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:06.479149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:06.546024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:06.547604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:06.642646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.654381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 83/169] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:06.655404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.713564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 87/170] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:44:06.714581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.762286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64197b-5e44-4e19-90eb-026ad7e32811 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.808716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.809695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.810129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.810615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:06.811757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.843513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:06.848678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:06.849844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:06.850889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:06.855965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 84/171] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:06.859551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.898205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27d033-fb68-4262-93d3-a19ba605e40d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:06.933917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:06.934577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.934861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.935136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.936402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:06.938063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f3afc-ad3f-4674-b7e0-46266a5c5103 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:06.943223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 88/172] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:06.943223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df9-75c7-400e-aefa-e6d2c9aa011a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:06.943223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df9-75c7-400e-aefa-e6d2c9aa011a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:06.943223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e45df9-75c7-400e-aefa-e6d2c9aa011a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:06.943223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 89/173] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:06.947714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45df9-75c7-400e-aefa-e6d2c9aa011a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:06.949760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.035724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384bb5-5209-4944-a534-925d79219b85 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.055823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e45df9-75c7-400e-aefa-e6d2c9aa011a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.089892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.094325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.095302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.095748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.096184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.097003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:07.097459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:07.099080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:07.109576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 90/174] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:07.114547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.114547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.114547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.114547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.114926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:07.114926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74add221-384b-4ed0-a899-9f07d4bc6f13 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:07.115283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:07.127370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 85/175] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:06 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:07.128695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.128982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.133848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.164257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:07.165459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:07.236343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e17c-d328-41a5-9dfe-57009c472b9a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.277855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.279057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.279499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.279927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.281666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=83657fa192a54fdc848106558d0816ba) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:07.282131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:07.283881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:07.293647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 91/176] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:07 2022] GET /identity/v3/role_assignments?user.id=83657fa192a54fdc848106558d0816ba&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:07.295861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:07.298832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 86/177] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:07.299793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:07.419911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.462308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.514545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd016c-8cb2-450c-9828-1c7df38f917f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.560959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecda57c-16a0-4e73-85d3-bc23adbadf5e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.564242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.564726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.565008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.565280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.566019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:07.566326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:07.567884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ae27a-183d-48a0-a0dd-7d4616fb57b3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:07.581889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 87/178] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:07 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:07.583689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d058-85c3-4276-a621-b6981ec5299a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.583982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d058-85c3-4276-a621-b6981ec5299a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.584260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d058-85c3-4276-a621-b6981ec5299a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.585682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 88/179] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:07.591288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818fe0-9914-47d1-90fb-743c6d4783f0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.591629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818fe0-9914-47d1-90fb-743c6d4783f0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.591988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818fe0-9914-47d1-90fb-743c6d4783f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.623100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e8818fe0-9914-47d1-90fb-743c6d4783f0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:07.628644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e8818fe0-9914-47d1-90fb-743c6d4783f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:07.636720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.637744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.638227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.638762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] PATH_INFO: `/v3/users/d489e73bfdd74cd59722698ff230be22` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.641446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] RBAC: Authorizing `identity:get_user(user_id=d489e73bfdd74cd59722698ff230be22)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:07.643167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed241aa0-b970-4683-b08d-55d97ee80158 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:07.645459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 92/180] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:07 2022] GET /identity/v3/users/d489e73bfdd74cd59722698ff230be22 => generated 275 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:07.646984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159b28-b6f5-4660-86db-5e29c036ed76 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.647523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159b28-b6f5-4660-86db-5e29c036ed76 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.647996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14159b28-b6f5-4660-86db-5e29c036ed76 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.649564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 93/181] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:07.650923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16461-0246-4322-911b-948d2af712d0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.651563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16461-0246-4322-911b-948d2af712d0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.652050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16461-0246-4322-911b-948d2af712d0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.657945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 94/182] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:07.659708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.660325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.660799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.681697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:07.684069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:07.740314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 89/183] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:07.740761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.741025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.741291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:07.771132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:07.772345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:07.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 95/184] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:07.774858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:07.823919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.824953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:07.892949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 90/185] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:07.894147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:07.927099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708f662-241d-47c8-a9d7-877b8a94e695 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:07.971062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:07.972188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:07.973017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:07.973734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.041487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5eb78-99c9-4686-b9e7-c2fd2301f383 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.084975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.086193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.086850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.087128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.087396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.088341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.099245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:08.103863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:08.105341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:08.106134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 91/186] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:08.106849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.139679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.146378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.210887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6c49e-c817-43ad-9708-9afcc888503d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.216987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 96/187] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:08.216987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.246169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.246735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.247009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.247275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.248381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.249825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.251449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 92/188] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.252194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.319445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e31c6f-5d5a-4b2a-8413-ad02e0977932 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.352360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.352957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.353316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.353491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.354149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:08.354471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.355866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.363521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 97/189] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.364285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.368745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.392859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.395514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011fd2d-5d7a-46d5-91e9-0fe74d085c5d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.427794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.428418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.428667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.428937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.439312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:08.443983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:08.444922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:08.445710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 93/190] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:08.446370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.473844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430b8b9-3d1d-427c-856c-d0327db2254f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.507643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.508207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.508481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.508753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.519220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:08.524344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:08.525233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:08.526062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 98/191] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:08.526794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.549022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0490ef-6a87-44ce-8d38-972d8d7fc384 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.582209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.582863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.583148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.583423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] PATH_INFO: `/v3/projects/3785717310a24dc7b665b40d6c9acc51` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.584547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] RBAC: Authorizing `identity:get_project(project_id=3785717310a24dc7b665b40d6c9acc51)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.586009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.586134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.587668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 94/192] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/projects/3785717310a24dc7b665b40d6c9acc51 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.588429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.619239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.625274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c2ba-7e3d-43d8-8385-6beed4fa03da None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.658708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.659320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.659595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.659862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.660498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.661932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.691140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e177-940d-474b-94be-97283f9c24d6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.723653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.724258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.724535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.724806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.737370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.744092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.744092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 95/193] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.744092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.771208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 99/194] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:08 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:08.771954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.844152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.862378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848aa0b-889c-4d0c-b202-52fa0389a682 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.882910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0820ae-f57e-4213-becc-d9e67609d527 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:08.900757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:08.904129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.904747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.905021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.905287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.905966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:08.906350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.907744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.919461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 96/195] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.919622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:08.922008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:08.922656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:08.923061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:08.923342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:08.924020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:08.925558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:08.925733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:08.935239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 100/196] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:08.936186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.045263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a6df9-6013-42ef-bf4e-b0cd83ace4a1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.064305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb570-83b6-4554-87a0-b8464f8b78bd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.091518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.092136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.092413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.092684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.093414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=3785717310a24dc7b665b40d6c9acc51, user.id=d489e73bfdd74cd59722698ff230be22) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:09.093726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.095193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.101486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 97/197] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/role_assignments?user.id=d489e73bfdd74cd59722698ff230be22&scope.project.id=3785717310a24dc7b665b40d6c9acc51&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:09.102198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.110649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.112027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.113311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.113806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.121444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.179250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.203776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.205594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.253189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0363b3-a75b-4050-8035-19fcc0861bc6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.303183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.303901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.304241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.304552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] PATH_INFO: `/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.305905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] RBAC: Authorizing `identity:get_user(user_id=99a8723fd9ea4ae0a4e680e5cd3f9977)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.307498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.309736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 98/198] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/users/99a8723fd9ea4ae0a4e680e5cd3f9977 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:09.314543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.352445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 101/199] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:09.353712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.418979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.443548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f309-cea6-41fb-a01a-fa1b269887da None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.456301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.489151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8ae2f-7a72-4b67-abbe-e0e6c25244c0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.494125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.496115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.496502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.496869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.498177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.499806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.501538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 99/200] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:09.506168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.540939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.542411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.543005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.543423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.629689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cdb0-00ac-424e-bea2-08470c43a826 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.636929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.639149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.672051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.672903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.673346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.673770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.675315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.676816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.678700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:09.679539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.699202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.731806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:09.761780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 102/202] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:09.761780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.815051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57643d-6108-4b86-a2b7-4d299b2f3fa3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.864472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.866087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.866593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.867083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.867879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad137fe-5c37-468d-9763-86a9e54159cc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:09.904812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:09.905589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:09.905709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:09.905925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:09.906685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=9fcf437b669a408586630885525e2b1e) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:09.906978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.908418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.914151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 103/203] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/role_assignments?user.id=9fcf437b669a408586630885525e2b1e&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:09.915185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:09.970197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:09.971832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:09.974211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:10.008765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:10.072332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59850d5-d64c-413b-b378-6f5319d448e2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:10.136085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:10.136885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.137170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.137446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.138750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:10.140548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:10.142593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:10.148485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:10.194086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 101/205] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:10.199769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:10.276198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f8ad-7060-480c-8c9c-f21f6d1931ef None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:10.291142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:10.316298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:10.317463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.317939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.318403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.319412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, scope.project.id=99d3817650c94124af95280168a5c3e4, user.id=99a8723fd9ea4ae0a4e680e5cd3f9977) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:10.319983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:10.321724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:10.329110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 105/206] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:10 2022] GET /identity/v3/role_assignments?user.id=99a8723fd9ea4ae0a4e680e5cd3f9977&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:10.390247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1ed95-eb88-4b4e-89d0-ca412e67270d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:10.409277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:10.428979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:10.429961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.430539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.431012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.432538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:10.434421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a77745-4245-4637-98a9-938da3e36177 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:10.441565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 102/207] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:10 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:10.443268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:10.553474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5eda0-b9cf-44c8-95de-1fb87a4d71fb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:10.590959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:10.591578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:10.591857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:10.592187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:10.592931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=9fcf437b669a408586630885525e2b1e) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:10.593239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:10.594732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfcea8-dec1-4526-aa15-e7ff736bd4c9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:10.600916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 106/208] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:10 2022] GET /identity/v3/role_assignments?user.id=9fcf437b669a408586630885525e2b1e&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:11.083821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6bece-0006-4db0-8d65-67559ca4734d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.084340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6bece-0006-4db0-8d65-67559ca4734d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.084340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6bece-0006-4db0-8d65-67559ca4734d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.085721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 103/209] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:11.093377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.093661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.093936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.099252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c014-99ed-4ac2-abdc-8c93c172b1e2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.099534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c014-99ed-4ac2-abdc-8c93c172b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.099804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c014-99ed-4ac2-abdc-8c93c172b1e2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.101262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 104/210] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:11.108010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.108290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.108563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.124514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:11.125703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:11.132980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:11.134965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:11.174956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:11.212792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:11.223058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:11.478738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.508606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.585005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522377d-b965-48eb-a0c0-08adba4302e6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.623047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.624294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.624785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.625391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.634301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011351-f425-46cd-b8ee-26ca077b495e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.639751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:11.645211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:11.646099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:11.651848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:11.654724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.655179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:11.675969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.676632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.676905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.677185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.678269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:11.679744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:11.681682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:11.687310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.692243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:11.768918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7ee6-b322-4db6-b6ab-c201de480d13 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.806376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.807566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.808062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.808547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.811542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207b02b-113b-4eb7-8002-2292a9c2b866 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.812319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:11.812833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:11.815754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:11.825139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:11.830984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:11.847530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.848385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.848844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.849294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:11.850097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:11.851739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:11.929510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:11.938387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7221-311d-4c78-bb20-b07f23047ad1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:11.967870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 107/216] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:11 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:11.983042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:11.983750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:11.984082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:11.984354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] PATH_INFO: `/v3/users/e68197027e19476294992d71d8ba7ba2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.003821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] RBAC: Authorizing `identity:get_user(user_id=e68197027e19476294992d71d8ba7ba2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:12.005411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5d07e-5f99-4759-9a27-ebccb606f119 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:12.007374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:11 2022] GET /identity/v3/users/e68197027e19476294992d71d8ba7ba2 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:12.014854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:12.059521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055571f7-f7ea-4ebc-8d99-deaee572f7dc None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.059708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055571f7-f7ea-4ebc-8d99-deaee572f7dc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.059986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055571f7-f7ea-4ebc-8d99-deaee572f7dc None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.061361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 111/218] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:12.062232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:12.066941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.067333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.067712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.090219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:12.091655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:12.134779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768be1-d7f2-42ad-82d2-8d61ebd808ae None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:12.179616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 112/219] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:12.182809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:12.182809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.183016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.183313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.264386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:12.265839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:12.308020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:12.370071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 108/220] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:12.376498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:12.467243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:12.468702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:12.488534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbebe1e-efc9-470b-8aa3-a723e7060be2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:12.541966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:12.542976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.543398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.543837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.545133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:12.547029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:12.548936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 113/221] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:12.555027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:12.594165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e908e5-8557-4c64-a203-9d2718dc5f32 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:12.636966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:12.637532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.637822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.638080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.650878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:12.651672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7031c574-2543-4f77-9feb-b45ad00109a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:12.659077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:12.660006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:12.661256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 109/222] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:12.662858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca934b-2ea7-41ce-87e7-f357a87d140c None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.663148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca934b-2ea7-41ce-87e7-f357a87d140c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.663422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca934b-2ea7-41ce-87e7-f357a87d140c None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.667332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 110/223] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:12.671871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca934b-2ea7-41ce-87e7-f357a87d140c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:12.702112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc89dd-ee0a-4591-8b55-c0995f169616 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:12.746060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:12.746700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.747122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.747406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.748932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=e68197027e19476294992d71d8ba7ba2) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:12.749249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:12.750715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2a2ab-e536-4f6d-8f84-1fae9e77de33 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:12.757183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 114/224] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/role_assignments?user.id=e68197027e19476294992d71d8ba7ba2&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:12.759022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.759318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.759594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.783191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:12.783384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca934b-2ea7-41ce-87e7-f357a87d140c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:12.784442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:12.794632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:12.867221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 115/225] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:12.881969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:12.882627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:12.882911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:12.883185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:12.883869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:12.884176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:12.885693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:12.906801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 111/226] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:12.912770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.026276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8054-cde3-4e2c-936d-bc6ab8152d14 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.060922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.061601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.061893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.062149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.063304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.064737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:13.066739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 116/227] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:12 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:13.072327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.173490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.226361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff11ce-1f09-44f4-927f-01c141814035 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.251310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.274876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.276575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.277407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.277529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.277746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.280674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.282124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:13.283975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 112/228] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:13.299204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.400389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce127-baae-4a0c-bf50-2987b345e74f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.439665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.440805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.443540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.444040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.465370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:13.473141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:13.474037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:13.475299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:13.476238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 117/229] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:13.487629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.500450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f6afa-eceb-42b6-8ec9-1a4d33853632 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.532521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.546042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.546872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.548002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.548002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/9fcf437b669a408586630885525e2b1e/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.550949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, user_id=9fcf437b669a408586630885525e2b1e, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.552473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:13.582476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:13.616310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c328-8205-4131-bef6-b98b049de4db None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.644719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 113/230] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:13 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/9fcf437b669a408586630885525e2b1e/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:13.652779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.653417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.653697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.653974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.654693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:13.655000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.656987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:13.667005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 118/231] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:13.672936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:13.839001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d2b-4787-459c-854c-d475405cc880 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:13.884626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:13.885313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:13.885592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:13.886124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:13.887348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:13.888807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:13.890408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 114/232] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:13.896134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:14.009651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507332-6213-4686-8c84-9f3071d6a5d8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:14.040364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:14.046069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:14.047001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.047497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.047993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.049383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:14.051143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878d4fd-4e27-4631-bcaa-a52c074a0513 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:14.053262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 119/233] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:13 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:14.059798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:14.165290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:14.224111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783db9b7-8660-44e6-aa10-fd12eb2fa496 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:14.275259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:14.276473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.276750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.277022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/9fcf437b669a408586630885525e2b1e/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.284316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, user_id=9fcf437b669a408586630885525e2b1e, role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:14.285772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9ff5-06fa-4077-8aa0-4b438f137df5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:14.366846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddeae-9948-4034-9570-3b81382e2c5e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.367864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddeae-9948-4034-9570-3b81382e2c5e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.368451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddeae-9948-4034-9570-3b81382e2c5e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.370295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 120/234] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:14.375032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cd7e4-e459-42f4-a76e-d2d2e2b5e1b1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.375316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cd7e4-e459-42f4-a76e-d2d2e2b5e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.375582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cd7e4-e459-42f4-a76e-d2d2e2b5e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.394325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fe6cd7e4-e459-42f4-a76e-d2d2e2b5e1b1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:14.395602 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fe6cd7e4-e459-42f4-a76e-d2d2e2b5e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:14.411315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:14 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/9fcf437b669a408586630885525e2b1e/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:14.500062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:14.864066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bea5e7-a44a-45da-a138-3cd58cff16c2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.864455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bea5e7-a44a-45da-a138-3cd58cff16c2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.864634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bea5e7-a44a-45da-a138-3cd58cff16c2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.865943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 116/237] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:14.871918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6940-c5f8-4ab9-b4d5-b9bc78c5caab None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:14.872196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6940-c5f8-4ab9-b4d5-b9bc78c5caab None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:14.872464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6940-c5f8-4ab9-b4d5-b9bc78c5caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:14.893656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8bdc6940-c5f8-4ab9-b4d5-b9bc78c5caab None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:14.895092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8bdc6940-c5f8-4ab9-b4d5-b9bc78c5caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:14.963425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bea5e7-a44a-45da-a138-3cd58cff16c2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:14.975919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:15.046214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c7fa-e755-4c93-bd2e-75aa1ec763e3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.046555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c7fa-e755-4c93-bd2e-75aa1ec763e3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.046795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c7fa-e755-4c93-bd2e-75aa1ec763e3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.048371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 123/239] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:15.056621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.056953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.057807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.087496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:15.088720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:15.115706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bea5e7-a44a-45da-a138-3cd58cff16c2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.146852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.179424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.180062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.180337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.180602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.190224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.194153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:15.199570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:15.200437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:15.201634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 117/240] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:15.211847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.231160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 124/241] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:15.315411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.345819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b820709-bc52-4e41-a8e3-d2acad070fad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.382143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.382713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.382991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.383267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.383935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:15.384234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:15.386020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:15.394568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 118/242] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:15.400112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.461811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.522571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e96a9-a58f-41bd-969d-25bff90db3f2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.555042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640a75-62d0-43bc-aec3-529d365d6a16 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.560674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.561396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.561743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.562603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.563805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:15.566156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:15.568582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 125/243] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:15.569887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.590934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.591564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.591848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.592122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] PATH_INFO: `/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.607230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] RBAC: Authorizing `identity:get_user(user_id=ebd2b12b28fc40bc84dcc0f2b9f07988)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:15.608921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:15.611015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 119/244] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:15.611802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.643659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.687631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030a1be-5d85-47f3-b37a-ef64397ee22a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.721183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.725179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.725986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.726428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.726889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c8b0-496e-4ad3-a522-9952e1939d27 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.727002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.737652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:15.743115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:15.744167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:15.745160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:15.747002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 126/245] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:15.747884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.763812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.764494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.764689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.764964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:15.765615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:15.767322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:15.863228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde821c-f84f-4808-abf9-80fe12f198a6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:15.877908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 120/246] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:15 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:15.879581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:15.882154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:15.924474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:15.925346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:15.925874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:15.926290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.020208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.022038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ac7a-ffef-45d0-9862-28b0c381f713 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.030725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6298-43dc-4358-bb7a-4c8a565588b8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.074826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.076123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.076604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.077104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.077782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:16.078085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.082010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900ae1e-5421-4f74-90e7-4192f601bbb4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.089747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 121/247] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:16.095500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c410a1b-c1ea-4d51-94f5-fe8c94366606 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.095792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c410a1b-c1ea-4d51-94f5-fe8c94366606 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.096117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c410a1b-c1ea-4d51-94f5-fe8c94366606 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.097721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 122/248] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:16.098463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c410a1b-c1ea-4d51-94f5-fe8c94366606 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.118276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:16.149302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 127/249] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:16.150689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.152108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.152398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.174886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:16.176117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:16.192045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:16.233140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c410a1b-c1ea-4d51-94f5-fe8c94366606 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.258542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 128/250] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:16.259294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.274320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.275000 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.275276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.275544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] PATH_INFO: `/v3/users/e68197027e19476294992d71d8ba7ba2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.277241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] RBAC: Authorizing `identity:get_user(user_id=e68197027e19476294992d71d8ba7ba2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.278723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.280530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 123/251] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:16 2022] GET /identity/v3/users/e68197027e19476294992d71d8ba7ba2 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:16.285945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.425767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1068-33b7-4fed-a176-72bc91d6f865 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.431098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:16.465374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328af7-d2e0-4d98-9506-9e8f11aceb9a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.502566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.503225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.503507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.503783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.505961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.508047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.511078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:16 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:16.517449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.540536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.541551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.542027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.542528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.543097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:16.547358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.549019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.550906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 124/253] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:16 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:16.556546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.690932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d5bd9-8b1a-4e2c-b85e-302d5542bc40 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.736790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.737758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.738238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.738766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.739855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=ebd2b12b28fc40bc84dcc0f2b9f07988) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:16.740380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.742175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.748883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 130/254] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:16 2022] GET /identity/v3/role_assignments?user.id=ebd2b12b28fc40bc84dcc0f2b9f07988&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:16.749889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:16.761122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c8c1-8425-4fb2-9028-bdb9d56fc71d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.827958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.828639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:16.828915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:16.829255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/e68197027e19476294992d71d8ba7ba2/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:16.831923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, user_id=e68197027e19476294992d71d8ba7ba2, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:16.833378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc80b7-54b7-4a8a-b9fa-3f818c5fa8a7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:16.909259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:16.922936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:16 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/e68197027e19476294992d71d8ba7ba2/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:16.945939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c6680-7942-4767-be02-c5409135ae22 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:16.998665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:16.999716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.000196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.000736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.012628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d159a-dead-4347-b104-8d3fcbbba72b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.012937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d159a-dead-4347-b104-8d3fcbbba72b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.013183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d159a-dead-4347-b104-8d3fcbbba72b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.015676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 126/256] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:17.019039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:17.020788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.021081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.021377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:17.025040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:17.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:17.026871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:17.029298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 131/257] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:17.036303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:17.045153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:17.046499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:17.050237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:17.163583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b6c77-d4df-439b-ba32-af212be76294 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:17.167986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 127/258] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:17.210586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:17.211532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.212012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.212524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.213413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:17.213913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:17.215668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:17.224921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 132/259] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:17.231345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:17.375931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b31d-5d10-4101-a0a7-28190639fdc0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:17.414021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:17.414680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.414958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.415227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.419184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:17.420656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:17.422557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:17 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:17.428168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:17.436236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:17.567993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23229d51-a3db-43a1-a976-9fa1b5464bd7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:17.612680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:17.613534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:17.613950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:17.614380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:17.697239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:17.698987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:17.700995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:17.807701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:17.816008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 133/261] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:17.830965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:17.832617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:17.979553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25dc36-bb73-4274-a772-a981797011f3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.039720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.040738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.041263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.041730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.067487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:18.073303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:18.074257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:18.075087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:18.077630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 129/262] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:18.082596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c23df-53eb-448a-892b-778740b5a89b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.082596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:18.084234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:18.144128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.144773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.145054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.145330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.146460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:18.147933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:18.150059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 134/263] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:17 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:18.159614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:18.236807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:18.325187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b2bbb-823f-4212-bf34-f50d0221086a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.330128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc61d2-df22-4a35-952e-3411d74fcc23 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.397566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.398184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.398463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.398760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.399497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=9fcf437b669a408586630885525e2b1e) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:18.399801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:18.401257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:18.412386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 135/264] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:18 2022] GET /identity/v3/role_assignments?user.id=9fcf437b669a408586630885525e2b1e&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:18.429910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.430921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.431433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.432443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.433354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:18.433853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:18.435474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:18.445744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 130/265] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:18.451840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:18.504532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:18.581614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65ccd7-1a69-4a8b-89d8-ab1a7b320594 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.623339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.623992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.624271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.624543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] PATH_INFO: `/v3/users/9fcf437b669a408586630885525e2b1e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.633150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] RBAC: Authorizing `identity:get_user(user_id=9fcf437b669a408586630885525e2b1e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:18.633150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524c221-3cc2-404f-965f-a6e155291a81 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:18.633952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 136/266] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:18 2022] GET /identity/v3/users/9fcf437b669a408586630885525e2b1e => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:18.643237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:18.769510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5196-a21b-42cf-82e9-37be7e9cacba None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:18.769695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c01a13-ee9e-487d-989d-38f621d80149 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.769946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c01a13-ee9e-487d-989d-38f621d80149 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.770226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c01a13-ee9e-487d-989d-38f621d80149 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.771879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 137/267] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:18.777171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6404-7d59-4573-b7bf-bfde9e7c1808 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.777171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6404-7d59-4573-b7bf-bfde9e7c1808 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.777171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd6404-7d59-4573-b7bf-bfde9e7c1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.808187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:18.815050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:18.815470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-91dd6404-7d59-4573-b7bf-bfde9e7c1808 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:18.816177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.816667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-91dd6404-7d59-4573-b7bf-bfde9e7c1808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:18.816885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.817344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.889760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:18.891767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:18.936036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 138/268] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:18.937456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa77b6-d6f4-47d3-ab67-26761cd7c4ff None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.937670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa77b6-d6f4-47d3-ab67-26761cd7c4ff None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.937947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa77b6-d6f4-47d3-ab67-26761cd7c4ff None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.943430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 139/269] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:18.951883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:18.952165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:18.952443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:18.991514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:18.992702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:19.007227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 131/270] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:19.014558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.053638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:19.060217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:19.133383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f349e0-9b78-4292-84a7-44f39eb245e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.153961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 140/271] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:19.182435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:19.183132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.183410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.183684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.184840 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:19.186346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:19.188093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 132/272] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:19 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:19.194158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.319407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5b75-b73e-47e1-840b-e6f9dc713c2f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.333701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.355970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:19.356977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.357459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.357940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.358985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=9fcf437b669a408586630885525e2b1e) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:19.359497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:19.361191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:19.367861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 141/273] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:19 2022] GET /identity/v3/role_assignments?user.id=9fcf437b669a408586630885525e2b1e&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:19.489294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:19.493553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ea9b-5f95-41e9-9a8a-1dab09c4b53b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.502360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.565579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:19.589676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:19.590722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.591203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.591730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.596055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:19.597865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc492-0310-4d77-a7eb-ea947f745ead None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:19.599787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 133/274] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:19.602119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57288-8511-4cd7-85c3-4035f23510ab None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.602322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57288-8511-4cd7-85c3-4035f23510ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.602594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57288-8511-4cd7-85c3-4035f23510ab None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.604310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 134/275] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:19.608872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab57288-8511-4cd7-85c3-4035f23510ab None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.665272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27103-f46b-4c22-b396-35f6f2ebd990 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.710265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:19.711219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.711642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.712419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.726667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c5d0b7cf-9995-49e5-90c7-fe3d85235b33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:19.732574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:19.733472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:19.734263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:19.736577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 142/276] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:19.738003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.738381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.738767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab57288-8511-4cd7-85c3-4035f23510ab None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.759815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:19.762159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:19.781886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:19.782507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.782831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.783190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.783838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:19.785392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85474811-ede3-4e38-9da8-7fb570e7d09d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:19.833941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 143/277] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:19.834819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:19.853792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:19.926551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 135/278] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:19 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:19.926551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d70ff-e45e-4190-b817-801c3b93beda None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.926551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d70ff-e45e-4190-b817-801c3b93beda None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.926551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d70ff-e45e-4190-b817-801c3b93beda None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.926551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 136/279] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:19.929131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:19.929501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:19.929776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:19.949645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:19.950936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:19.955321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849895-1a5e-45ae-be27-ccbbd711762a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:19.975156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.002827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.003751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.004080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.004369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.005060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:20.005370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.007199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.019975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 144/280] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.025999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.036729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 137/281] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:20.110848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.116768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.140733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0995-def6-4f2a-bb23-79b85051c92e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.189977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.191134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.191417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.191964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] PATH_INFO: `/v3/users/c41444830718402fac44364a78f50bad` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.209556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c41444830718402fac44364a78f50bad)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.211365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.213254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 145/282] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/users/c41444830718402fac44364a78f50bad => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.219000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.228990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7df1-5ee6-44c4-a132-7e95e86fbfd7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.271688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd08-2495-495c-917f-057049376d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.272254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd08-2495-495c-917f-057049376d8f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.272531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd08-2495-495c-917f-057049376d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.272815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd08-2495-495c-917f-057049376d8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.286425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faacd08-2495-495c-917f-057049376d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6faacd08-2495-495c-917f-057049376d8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:20.293263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:20.305337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 138/283] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:20.306132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd08-2495-495c-917f-057049376d8f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.319859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.354196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b066c1-abe1-4f54-8778-3bb08436f9e8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.394324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.394981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.395306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.395583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.396422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, user.id=c41444830718402fac44364a78f50bad, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:20.396730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.398162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.401493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.406599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 146/284] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/role_assignments?user.id=c41444830718402fac44364a78f50bad&scope.system=all&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:20.407870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.429415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd08-2495-495c-917f-057049376d8f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.477472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.478241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.479152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.479499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.480299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:20.480689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.482272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.492441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 139/285] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.499224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.551638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1925-79dd-48ab-a737-8e887cdb6ae5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.594932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.598455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:20.670742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:20.671769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:20.672740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 147/286] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:20.673823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.674369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387486-990c-43c0-bf98-2be06f9c04fc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.697369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.716677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.717567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.717567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.717838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] PATH_INFO: `/v3/users/e68197027e19476294992d71d8ba7ba2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.721959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] RBAC: Authorizing `identity:get_user(user_id=e68197027e19476294992d71d8ba7ba2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.723405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.727915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 140/287] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/users/e68197027e19476294992d71d8ba7ba2 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.731367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.745582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f474b-45d3-4cc8-b6cc-c2b0c4f8fc89 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.782444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.783306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.783742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.784159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.784970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:20.785414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.786943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.797259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 148/288] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.803111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.916463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f73b33-d4e8-4e0e-b094-9c152c288e31 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:20.941043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:20.954028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:20.954914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:20.955344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:20.955774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] PATH_INFO: `/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:20.957493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] RBAC: Authorizing `identity:get_user(user_id=ebd2b12b28fc40bc84dcc0f2b9f07988)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:20.959102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:20.960826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 149/289] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:20.966900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:20.967922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3a2c6-ca58-485d-96fc-f9313c21fc0a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:21.073907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edc51-bfae-44d2-a96e-c450840f226f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:21.079176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:21.079798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:21.080083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:21.080358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:21.102858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:21.112812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:21.113636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:21.114146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:21.114688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:21.123028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:21.123028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:21.123028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 150/290] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:21.125885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:21.190377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:21.191883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:21.228475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:21.300871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268620-6281-4e03-8588-a1ccaeb0e015 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:21.357648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:21.358320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:21.358628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:21.358906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/ebd2b12b28fc40bc84dcc0f2b9f07988/roles/a18f90993c7f4f12a0ae9c6f37328264` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:21.363264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, user_id=ebd2b12b28fc40bc84dcc0f2b9f07988, role_id=a18f90993c7f4f12a0ae9c6f37328264)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:21.364717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:21.380689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 141/291] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:21.386693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:21.429505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:21.450226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:21 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/users/ebd2b12b28fc40bc84dcc0f2b9f07988/roles/a18f90993c7f4f12a0ae9c6f37328264 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:21.511980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0574c-e7f1-42da-8f23-a7692b43d376 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:21.567897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:21.568546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:21.568826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:21.569164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:21.570375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:21.571860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76304540-ce92-4d14-862f-291b5b1c8957 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:21.574433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:21 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:21.580481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:21.736476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c18a-573d-45f3-bab9-c248bb7c0a7b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:21.761542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:21.779621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:21.780231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:21.784115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:21.784115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:21.784115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=e68197027e19476294992d71d8ba7ba2) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:21.784115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:21.784115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eaa8c-8b17-49e3-925e-fb21a97db5d5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:21.790393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 152/294] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:21 2022] GET /identity/v3/role_assignments?user.id=e68197027e19476294992d71d8ba7ba2&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:22.361956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc8df-dfd7-4e5f-b6c1-b4ab55b1bda9 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.362488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc8df-dfd7-4e5f-b6c1-b4ab55b1bda9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.362488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdc8df-dfd7-4e5f-b6c1-b4ab55b1bda9 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.364218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 143/295] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:22.370484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce93e-17e8-4304-9051-8a0b2cd69016 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.370794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce93e-17e8-4304-9051-8a0b2cd69016 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.371070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ce93e-17e8-4304-9051-8a0b2cd69016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.379073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb84c6a-ae6b-405d-a02c-09b76261b922 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.379361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb84c6a-ae6b-405d-a02c-09b76261b922 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.379636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb84c6a-ae6b-405d-a02c-09b76261b922 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.381083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 144/296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:22.390560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309abb8-924b-4fd5-973e-0d345aaadaeb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.390560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309abb8-924b-4fd5-973e-0d345aaadaeb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.390560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309abb8-924b-4fd5-973e-0d345aaadaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.400043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5a2ce93e-17e8-4304-9051-8a0b2cd69016 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:22.401272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5a2ce93e-17e8-4304-9051-8a0b2cd69016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:22.410088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d309abb8-924b-4fd5-973e-0d345aaadaeb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:22.412153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d309abb8-924b-4fd5-973e-0d345aaadaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:22.485352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 153/297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:22.506152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 145/298] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:22.702365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d5cb-b1bd-4240-9443-4a5cc45c8fbc None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.702578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d5cb-b1bd-4240-9443-4a5cc45c8fbc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.702916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d5cb-b1bd-4240-9443-4a5cc45c8fbc None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.704522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 154/299] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:22.711766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.712165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.712538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.731369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:22.732719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:22.754072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8d5cb-b1bd-4240-9443-4a5cc45c8fbc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:22.768434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:22.801301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 146/300] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:22.802175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:22.877444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8d5cb-b1bd-4240-9443-4a5cc45c8fbc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:22.894983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:22.913684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8548fe-f2f9-4669-a995-d35f324b2c11 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:22.921199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:22.921828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.922105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.922379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.923533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:22.925867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:22.927780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 155/301] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:22.932874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:22.961511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:22.962068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:22.962346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:22.963180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:22.976446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:22.982557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:22.983444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:22.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 147/302] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:22.989386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.020604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:23.069239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fe51-02bf-4023-aea1-a8de090438b7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.091614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc525ab-9634-4afd-bcf2-68b37b02e299 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.104840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.105444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.105723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.105979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] PATH_INFO: `/v3/groups` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.106768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.108013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.127194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.130777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.139607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 148/303] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:23.141495 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.179920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 156/304] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Aug 12 11:44:22 2022] POST /identity/v3/groups => generated 229 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:44:23.180650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.240024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:23.271710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:23.284885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454b0-dca2-4b81-87d2-253ab0dbcaf9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.312610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185cf6d-fae6-409c-9271-097ba3474a51 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.336332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.336551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.336755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.338561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.355440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:23.356407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.357126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.357409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.357690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] PATH_INFO: `/v3/users/f7b8853c9390470984af3b747fe94e27` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:23.360085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:23.360939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:23.366320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 149/305] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:23.370466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.378134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b8853c9390470984af3b747fe94e27)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.380105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.383729 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 157/306] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:23 2022] GET /identity/v3/users/f7b8853c9390470984af3b747fe94e27 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:23.392292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.486391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38c23a-4e82-4bdc-9b01-18e74705ff4a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.518626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:23.523161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb3b47-16a3-4660-af20-6ba12fee48f6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.532231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.533566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.533997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.534414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.535259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:23.536060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.537909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.548647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 150/307] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:23.554429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.574167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:23.583992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.588303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.588303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.588303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.588303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, user.id=f7b8853c9390470984af3b747fe94e27, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:23.588303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.588659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.594058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 158/308] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Aug 12 11:44:23 2022] GET /identity/v3/role_assignments?user.id=f7b8853c9390470984af3b747fe94e27&scope.system=all&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:23.674548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7166b-c1e3-450b-a356-498ff02ea281 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.716083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.717201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.717713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.718197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] PATH_INFO: `/v3/users/c41444830718402fac44364a78f50bad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.719620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c41444830718402fac44364a78f50bad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.721300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50ca0-b281-4874-a805-7ee4745ba3b2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.723573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 151/309] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:23 2022] GET /identity/v3/users/c41444830718402fac44364a78f50bad => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:23.734544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:23.787434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8657c-b2cd-47c9-a7e9-ade0e626d9ab None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.787759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8657c-b2cd-47c9-a7e9-ade0e626d9ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.787923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8657c-b2cd-47c9-a7e9-ade0e626d9ab None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.789510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 152/310] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:23.794676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175014bb-1308-4473-a40a-431900e3a05d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.794829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175014bb-1308-4473-a40a-431900e3a05d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.795027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175014bb-1308-4473-a40a-431900e3a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.815821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-175014bb-1308-4473-a40a-431900e3a05d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:23.817005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-175014bb-1308-4473-a40a-431900e3a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:23.857413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6ac5-4463-4380-a3f4-caab61420125 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:23.902102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:23.902883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:23.903161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:23.903434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] PATH_INFO: `/v3/system/users/c41444830718402fac44364a78f50bad/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:23.904482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 153/311] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:23.906831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c41444830718402fac44364a78f50bad, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:23.908413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:23.992241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 159/312] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Aug 12 11:44:23 2022] PUT /identity/v3/system/users/c41444830718402fac44364a78f50bad/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:24.199177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175014bb-1308-4473-a40a-431900e3a05d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:24.216312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:24.317128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175014bb-1308-4473-a40a-431900e3a05d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:24.358961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:24.359592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:24.359865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:24.360256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:24.373281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:24.377919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:24.378790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:24.379616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:24.383848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 154/313] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:24.386060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:24.416691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:24.500199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274af0-b6f5-453e-ac09-8d6fd73ad75b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:24.544193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:24.544893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:24.545168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:24.545439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:24.546180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:24.546485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:24.547868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:24.556561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 160/314] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:24.564836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:24.644120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:24.675293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36460f0-c223-46ef-a1cc-28fef679f3f3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:24.711631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:24.712257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:24.712555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:24.712852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] PATH_INFO: `/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:24.713977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] RBAC: Authorizing `identity:get_user(user_id=ebd2b12b28fc40bc84dcc0f2b9f07988)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:24.715497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:24.717069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 155/315] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:24 2022] GET /identity/v3/users/ebd2b12b28fc40bc84dcc0f2b9f07988 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:24.723164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:24.825288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:24.838550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1db7dd-6a1b-4a4d-88d5-5cc58808ff30 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:24.875107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:24.875755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:24.875974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:24.876299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:24.944833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:24.946292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2481c-790e-4d87-88bf-026ccca0f2c3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:25.033427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:25.050670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 161/316] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:44:25.052357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:25.156444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ca7a9-39d5-4f04-9944-0c0ea9449b36 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:25.182224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f610-712b-4773-872e-0298971b8e07 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.182559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f610-712b-4773-872e-0298971b8e07 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.182788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f610-712b-4773-872e-0298971b8e07 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.184852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 162/317] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:25.191836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.192265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.192791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.198872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:25.199699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.200126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.200535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.201879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:25.203517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:25.205588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 156/318] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:25 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:25.211430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:25.218095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:25.219558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:25.223924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:25.288568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 163/319] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:25.368056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8495af-17c8-45aa-9a9b-93d4c8411b08 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:25.404209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:25.404807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.405088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.405365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.406093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, scope.project.id=76650ff6f0f24292b99370acb7c5932b, user.id=ebd2b12b28fc40bc84dcc0f2b9f07988) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:25.406403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:25.407869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526e449-d6c8-47fc-b641-e0c2e121de42 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:25.417882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 157/320] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:25 2022] GET /identity/v3/role_assignments?user.id=ebd2b12b28fc40bc84dcc0f2b9f07988&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:25.560733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:25.620100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218280d-c4d0-46fc-8939-0c14752cc285 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.620377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218280d-c4d0-46fc-8939-0c14752cc285 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.620654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218280d-c4d0-46fc-8939-0c14752cc285 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.622192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 158/321] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:25.629510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.630045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.630491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.660485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:25.661703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:25.678945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2aa2-ffc6-446e-8491-273c92c37919 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:25.697132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:25.713667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:25.714312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.714610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.714882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.715989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:25.717399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:25.719176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 164/322] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:25.724430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:25.740918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:25.826544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01952-67bb-4148-a70d-2600fe5738b4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:25.863618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:25.864233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:25.864509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:25.864781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] PATH_INFO: `/v3/groups` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:25.865401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:25.866847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74913e55-bd55-4896-a79e-d1eb8d7b62e0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:25.965631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 165/324] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Aug 12 11:44:25 2022] POST /identity/v3/groups => generated 226 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:44:26.016986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.019220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:26.120280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6db6e-f931-482f-acad-b2812ad1cf4a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.120808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6db6e-f931-482f-acad-b2812ad1cf4a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.121080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6db6e-f931-482f-acad-b2812ad1cf4a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.123083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 166/325] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:26.127731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.128010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.128280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.128477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb4032-e805-4dd0-b5d3-92025a599b3b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.150658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:26.152589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:26.167825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.168696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.169115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.169382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.180620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:26.185501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:26.186377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:26.187271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 160/326] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:26.194638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.216228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:26.251048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 167/327] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:26.273299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:26.364778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e3910-e736-4b55-8f10-59ab560df6fa None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.403133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.403965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.404384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.405251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.405936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:26.406239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:26.407658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:26.417497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 161/328] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:26.423434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.542892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412801b-0093-4c4f-bbf9-6b16c00e7dae None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.556380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.590187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.590960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.591243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.591610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] PATH_INFO: `/v3/users/f7b8853c9390470984af3b747fe94e27` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.592756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] RBAC: Authorizing `identity:get_user(user_id=f7b8853c9390470984af3b747fe94e27)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:26.594194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:26.596344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 168/329] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/users/f7b8853c9390470984af3b747fe94e27 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:26.604083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.660402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:26.688151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55055-f688-47d5-8b50-1f9b32bc3170 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.725127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:26.732727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d16a00-2bc5-4f3a-a25e-4fcbb410cc7b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.736457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.737150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.737433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.737705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.751540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:26.757224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:26.758099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:26.759539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 162/330] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:26.765020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:26.782462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.783158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.783431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.783707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] PATH_INFO: `/v3/system/users/f7b8853c9390470984af3b747fe94e27/roles/a18f90993c7f4f12a0ae9c6f37328264` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.786277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7b8853c9390470984af3b747fe94e27, role_id=a18f90993c7f4f12a0ae9c6f37328264)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:26.787694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:26.856926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 169/331] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Aug 12 11:44:26 2022] PUT /identity/v3/system/users/f7b8853c9390470984af3b747fe94e27/roles/a18f90993c7f4f12a0ae9c6f37328264 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:26.899219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c4a9a-afb0-4856-98a2-06237c7e464c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:26.936094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:26.936625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:26.936901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:26.937224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:26.937908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:26.938206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:26.939784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:26.954665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 163/332] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:26.960005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:27.074186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a708c7-0c5e-47dd-9a16-94a81a9708db None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:27.083724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:27.117193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:27.117853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:27.118136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:27.118411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] PATH_INFO: `/v3/users/c41444830718402fac44364a78f50bad` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:27.119859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] RBAC: Authorizing `identity:get_user(user_id=c41444830718402fac44364a78f50bad)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:27.121359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733430d7-7d85-4f6f-8fef-3426b3764e5a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:27.123279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 170/333] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:26 2022] GET /identity/v3/users/c41444830718402fac44364a78f50bad => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:27.129632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:27.182896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:27.245703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc61a0-1236-4fdd-8bec-3c2a5b18d3a7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:27.288563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:27.289231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:27.289514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:27.289786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:27.290557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] RBAC: Adding query filter params (role.id=6c5390de52524fd1ab2f9f4d74b70761, user.id=c41444830718402fac44364a78f50bad, scope.system=all) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:27.290871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:27.292376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a007-424d-477f-b1cb-5038883ee263 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:27.310583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 164/334] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Aug 12 11:44:27 2022] GET /identity/v3/role_assignments?user.id=c41444830718402fac44364a78f50bad&scope.system=all&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:28.285294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978dbff-96c4-4908-8dce-9544b35f2400 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:28.285797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978dbff-96c4-4908-8dce-9544b35f2400 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:28.285899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978dbff-96c4-4908-8dce-9544b35f2400 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:28.287227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 171/335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:28.297329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c3db-c224-42c8-9943-dd32b72ee20a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:28.297329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c3db-c224-42c8-9943-dd32b72ee20a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:28.297329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724c3db-c224-42c8-9943-dd32b72ee20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:28.314504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0724c3db-c224-42c8-9943-dd32b72ee20a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:28.315998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0724c3db-c224-42c8-9943-dd32b72ee20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:28.501762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 165/336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:28.786239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978dbff-96c4-4908-8dce-9544b35f2400 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:28.834670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bab6fd-1032-46fb-b3d0-84823f42478b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:28.835205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bab6fd-1032-46fb-b3d0-84823f42478b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:28.835615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bab6fd-1032-46fb-b3d0-84823f42478b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:28.837081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 166/337] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:28.842476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:28.843596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:28.844046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:28.873240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:28.874420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:28.934141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:28.967790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978dbff-96c4-4908-8dce-9544b35f2400 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:29.015037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:29.021355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:29.021994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.022270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.022553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.042383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:29.047036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:29.047921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:29.048716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 172/339] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:29.054167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:29.207503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a7dcd-ae42-426e-ac13-0ee2bb5c7c52 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:29.252892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:29.253538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.253818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.254087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.254805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:29.255108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:29.256521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb60a0-c9d0-414d-8c24-3e2d60fc3e1e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:29.269586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 168/340] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:29.274924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:29.329244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:29.414357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c46720-0527-4e29-898d-2b55fae3c029 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:29.454037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:29.454687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.454966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.455235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.530098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da04c2-28c7-4fd2-bc32-9be87ad0d68a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.530628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da04c2-28c7-4fd2-bc32-9be87ad0d68a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.530628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da04c2-28c7-4fd2-bc32-9be87ad0d68a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.532113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 169/341] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:29.539821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.539821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.539821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.552672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:29.554122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:29.576101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:29.577290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:29.614884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:29.633076 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:29.715504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 170/342] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:29.716367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:29.750337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 173/343] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:29.756411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:29.883554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7f2d-94c6-48b8-8ad7-d76b0dc1852f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:29.887841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e922854-c046-4aa8-9779-7f1b02bbccc3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:29.939460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:29.940101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.940373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.940638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.942839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:29.944271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567af94-0229-4b0a-8215-b3323aa1aff7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:29.946064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 174/344] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:29 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:29.956737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9824-7d96-4e77-b8ae-852e1103a0de None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.957019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9824-7d96-4e77-b8ae-852e1103a0de None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.957292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a9824-7d96-4e77-b8ae-852e1103a0de None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.958732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 175/345] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:29.964724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.965000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.965270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.971383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:29.972019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:29.972292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:29.972562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:29.979534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:29.992535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:29.997768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:29.998849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:29.999682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:30.000289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:30.001394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:30.003698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 171/346] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:30.004845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.049256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.116851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:30.117888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.167678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab011d-fde8-46bd-96a0-052dabbdf134 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.213139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.213776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.214046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.214310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.220894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:30.222395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:30.224227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 172/348] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:30.224823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.251930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a67b-e60d-469b-9db3-fb1a40617d16 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.303486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.304103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.304377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.304642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.305304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:30.305600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:30.310379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:30.316400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.330846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 177/349] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:30.333346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.340480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.380804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cbefd-c185-4532-bc7d-cfd75944ea38 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.450441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.451023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.451296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.451560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.479987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:30.492623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:30.494140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:30.495348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 173/350] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:30.503367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.516901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da05a9-58fa-48d9-90e3-d6fcbd821d26 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.567374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.567952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.568234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.568506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.569229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=99d3817650c94124af95280168a5c3e4) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:30.569532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:30.572565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:30.580150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 178/351] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:30.581019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.659189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c8c2-f849-46f8-9a22-0f51816890df None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.660363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.705759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.706782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.707471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.707756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.715080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbda705-140f-4d05-a5c9-1a14bfc9a8cb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.720163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.764067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.764704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.764987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.765364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.766081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:30.766389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:30.767872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:30.777757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 179/352] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:30.778622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.794257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:30.796374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6579b7-e451-4f07-9084-43648683ed87 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:30.911674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09b498-6958-4d03-a7ac-a3e986c37943 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:30.935137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 174/353] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:30.935997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec75a5-7360-408f-a8f6-c3e71377e9a2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.936279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec75a5-7360-408f-a8f6-c3e71377e9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.936547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec75a5-7360-408f-a8f6-c3e71377e9a2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.940923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 175/354] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:30.940923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32300-155e-4353-ab29-ef88d3e2599d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.940923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32300-155e-4353-ab29-ef88d3e2599d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.940923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd32300-155e-4353-ab29-ef88d3e2599d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.940923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 176/355] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:30.941643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32300-155e-4353-ab29-ef88d3e2599d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:30.951208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:30.966250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:30.967840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.968327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.968798 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:30.981504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-492c4860-fe7a-4c95-b2aa-327fcc7cc9b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:30.988559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:30.989434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 11:44:30.990273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:30.992806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 180/356] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:30.994465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a9a-70ce-497b-b6a0-c21d8a4b122e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:30.994794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a9a-70ce-497b-b6a0-c21d8a4b122e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:30.995067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a9a-70ce-497b-b6a0-c21d8a4b122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.005837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.018429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fb170a9a-70ce-497b-b6a0-c21d8a4b122e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:31.020087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb170a9a-70ce-497b-b6a0-c21d8a4b122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:31.095084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd32300-155e-4353-ab29-ef88d3e2599d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.113093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 181/357] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:31.113093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.113093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.113093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.130625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:31.131920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:31.138647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.139270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.139547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.139815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.207982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 182/358] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:31.214884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.242028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.245046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.270782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.309320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.343787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccf7ab-2603-4c98-be36-e00d58390dfe None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.386606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.387776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.388265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.388743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.390069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.391871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.393808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 183/359] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:31.394767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.435633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 177/360] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:31.436319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.517385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123305ad-f0f1-4199-b9d9-86e26187bd30 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.529957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.557390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.558613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.558885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.559155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.560081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:31.560380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.562902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.580238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 184/361] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:31.581702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.603836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f0884-6959-4455-a613-75d7e470ccbf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.648835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.649553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.650395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.650701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.651831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.653278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.655187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 178/362] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:31.661222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.677767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.707077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d920c-9e42-4634-baf2-aa6cb4036ceb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.745011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.745646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.745923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.746199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.747382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.748819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.750591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 185/363] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:31.755527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.783579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810720e-f6bf-44f6-be19-126831b2540d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.812826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.826175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.827019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.827132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.829300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.839390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:31.844137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:31.845009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:31.845830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 179/364] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:31.846683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.885437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ca12-68a6-4241-8643-973ad369d4f2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:31.938225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:31.942116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:31.942784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:31.943067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:31.943346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] PATH_INFO: `/v3/users/f7b8853c9390470984af3b747fe94e27` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:31.944859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] RBAC: Authorizing `identity:get_user(user_id=f7b8853c9390470984af3b747fe94e27)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:31.946004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:31.948206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 186/365] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/users/f7b8853c9390470984af3b747fe94e27 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:31.948977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:31.984317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d427c-d6e2-49bf-b52d-87114a7d30ec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.032186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.032795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.033078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.033349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.034473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=99d3817650c94124af95280168a5c3e4) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:32.034818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.037221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.044120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 180/366] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.045205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.099384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339518b-1141-4f83-8b85-ec50e705357e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.112541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.143321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.144385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.144858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.145374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.161210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:32.167323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:32.168285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:32.169084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:32.174591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 187/367] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:32.175552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.180513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addac84-7e6f-462c-a7a6-57fe718e624c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.224054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.231512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.232799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.233219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.234161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.235284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.237020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.240980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 181/368] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.241729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.310305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696427f8-58b7-433d-a848-fcdab1ad70ef None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.350431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.351098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.351346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.351692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.352355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:32.353183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.354575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.363088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.367378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.370392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc249f-195c-420f-9829-2caabc519ccb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.404755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.413267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] RBAC: Adding query filter params (role.id=a18f90993c7f4f12a0ae9c6f37328264, user.id=f7b8853c9390470984af3b747fe94e27, scope.system=all) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.420069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.435887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/role_assignments?user.id=f7b8853c9390470984af3b747fe94e27&scope.system=all&role.id=a18f90993c7f4f12a0ae9c6f37328264 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.436823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.525210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.577624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58d15d-23c4-4512-a439-3e27c5077e9c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.578086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc4c64-b38a-4fd4-addc-0707cc467b1c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.637357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.638217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.638666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.639103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.639981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=76650ff6f0f24292b99370acb7c5932b) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:32.640440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.642009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.647683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.648388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.648569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.648861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.649013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 183/371] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.650151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:32.650459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.651658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.651847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.664278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 189/372] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:32.670415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:32.765273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a410-6027-4370-940a-4ae04e528f7f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.785918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.793578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:32.796576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e660e-753a-4868-b93a-4317b121a9c2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:32.805989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.806884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.807305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.807744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.842218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:32.842218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:32.842218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:32.842218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:32.883707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.886206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.918246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:32.919782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:32.995282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 184/373] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:33.001299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.027429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.047699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 190/374] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:44:33.048435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.054730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.107984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33faab-c82d-4562-9d20-bfa9e71c116e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.145387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.146032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.146308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.146717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.147908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.149356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a9c68-babf-4f47-b6a3-1980c0312ea9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.151983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 185/375] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:33.153301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b752-1399-4e84-b08c-85ae6d4f55fe None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.153576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b752-1399-4e84-b08c-85ae6d4f55fe None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.153894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b752-1399-4e84-b08c-85ae6d4f55fe None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.155442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 186/376] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:33.158124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b752-1399-4e84-b08c-85ae6d4f55fe None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.190967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23037d-5da9-4cb2-876d-3858acef8386 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.226372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.227042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.227321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.227618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] PATH_INFO: `/v3/projects/65344c3d4d6c482091ff358a1b54d508` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.228755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=65344c3d4d6c482091ff358a1b54d508)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.230200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546a2b2-221b-41a7-b8c1-728e119ff6b6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.232209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 191/377] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/projects/65344c3d4d6c482091ff358a1b54d508 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:33.233402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447a44-4982-4455-9144-174bb67f312e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.233743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447a44-4982-4455-9144-174bb67f312e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.234025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447a44-4982-4455-9144-174bb67f312e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.253883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-95447a44-4982-4455-9144-174bb67f312e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:33.255127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-95447a44-4982-4455-9144-174bb67f312e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:33.259887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.272365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b752-1399-4e84-b08c-85ae6d4f55fe None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.314991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.315745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.316577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.317180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.317470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.318952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.320572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.323737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 187/378] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:33.325207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.329193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 192/379] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:33.335683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95447a44-4982-4455-9144-174bb67f312e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.453185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bd842-0221-42f0-994a-089fc1f105bf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.501943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.502693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.502980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.503447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] PATH_INFO: `/v3/groups/4149c929e004435cae6ccb2de6c417dd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.506868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95447a44-4982-4455-9144-174bb67f312e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.508677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] RBAC: Authorizing `identity:get_group(group_id=4149c929e004435cae6ccb2de6c417dd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.511626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.513428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 188/380] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/groups/4149c929e004435cae6ccb2de6c417dd => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:33.519478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.546842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.547985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.548431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.548853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.549974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=76650ff6f0f24292b99370acb7c5932b) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:33.550422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.552515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.560145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 193/381] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:33.570184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.646804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.681809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2a9a-f690-4797-a738-8f9a6c8d00f4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.734916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.735471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.735797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.736073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.737005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] RBAC: Adding query filter params (group.id=4149c929e004435cae6ccb2de6c417dd, role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=65344c3d4d6c482091ff358a1b54d508) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:33.737322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:33.738920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:33.746348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 189/382] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/role_assignments?group.id=4149c929e004435cae6ccb2de6c417dd&scope.project.id=65344c3d4d6c482091ff358a1b54d508&role.id=5540f9b1011544929fd18ae216a070b0 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:33.751315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:33.804545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b527-70aa-4fbe-95ac-d808dd269c40 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:33.852334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:33.853521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:33.853801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:33.854073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:33.870095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:33.875428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:33.876357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:33.877153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 194/383] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:33.882763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:33.982196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:34.000649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5851fd2-2b33-4fb2-8457-68807f7ace58 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:34.047025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:34.047637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.047916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.048195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.048876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:34.049177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:34.050577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:34.059910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 190/384] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:34.068388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:34.266781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369993c4-d79c-4f5d-9484-57fc81f15e35 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:34.282177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:34.308340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:34.308982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.317829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.317829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.317829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:34.317829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:34.317829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 195/385] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:34 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:34.319585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:34.423723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecbf7-5ca2-4648-aefa-be87312a68b8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:34.467367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:34.467367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.467367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.467367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.468552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:34.470551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc4bf9-7438-4ace-9aae-1ce66b4a5578 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:34.474555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 191/386] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:34 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:34.477295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:34.600411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127b82-6cf5-49a1-b34a-8af45c1a2d8f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:34.642911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:34.643573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.643853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.644126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.646033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, group_id=39cb5d4caf644a5da4ac3470ba1952ef, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:34.647503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:34.656568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef8c3-e3dd-4aff-8a78-d190c92d9e42 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.656986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef8c3-e3dd-4aff-8a78-d190c92d9e42 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.657387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cef8c3-e3dd-4aff-8a78-d190c92d9e42 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.659597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 192/387] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:34.665716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:34.671843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:34.671843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:34.687808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:34.689000 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:34.702924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:34.733764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 196/388] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Aug 12 11:44:34 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:34.780365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 193/389] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:35.131148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:35.186770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:35.252884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59b50d-c72c-4be2-abbb-8bd2123456fb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:35.299993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:35.300662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.300939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.301221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.323509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:35.328895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:35.329755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:35.335545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 197/390] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:35.336224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:35.497259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260782-9cf0-46db-8b49-0b1d32f43e05 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:35.539001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:35.540050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.541040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.541496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.542343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:35.542880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:35.544427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:35.556458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 194/391] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:35.561662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:35.669035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132023ab-e49f-4c09-8c15-ce57bf66c52b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:35.671436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:35.708874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:35.709582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.709860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.710128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.711313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:35.713285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beae8a-db8d-4dfc-b346-b42000d9de0c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:35.714886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 198/392] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:35 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:35.720865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:35.733156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:35.742008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cb4dc-6b63-4098-8de5-52ebe7e9fc25 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.742362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cb4dc-6b63-4098-8de5-52ebe7e9fc25 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.742652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cb4dc-6b63-4098-8de5-52ebe7e9fc25 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.744126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 199/393] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:35.749700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.749912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.750148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.777339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:35.778550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:35.910416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 200/394] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:35.910805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54104e92-11f7-45c8-9881-65c46ad40a6e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:35.953672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:35.953976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:35.954229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:35.954483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:35.955728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:35.957219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0f754-4dc0-466e-8340-52569c553fee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:35.961683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:35 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:35.968003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.075571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87dcf3-b8bd-48a6-9261-a0dd7ddf57e7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.077452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.111162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.111828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.112110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.112448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.114700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] RBAC: Authorizing `identity:create_grant(project_id=99d3817650c94124af95280168a5c3e4, group_id=39cb5d4caf644a5da4ac3470ba1952ef, role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:36.116144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3327-97f8-4e8a-9652-2363abef0a24 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:36.199896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 201/396] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Aug 12 11:44:35 2022] PUT /identity/v3/projects/99d3817650c94124af95280168a5c3e4/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:36.225807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beede-1d93-48e5-a9b4-286b5c0af1f4 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.226136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beede-1d93-48e5-a9b4-286b5c0af1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.226421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beede-1d93-48e5-a9b4-286b5c0af1f4 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.228150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 196/397] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:36.234154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903f06-d0a1-47a6-b3ae-a4d8a76bfaa4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.234488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903f06-d0a1-47a6-b3ae-a4d8a76bfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.234786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903f06-d0a1-47a6-b3ae-a4d8a76bfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.260724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ff903f06-d0a1-47a6-b3ae-a4d8a76bfaa4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:36.261971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff903f06-d0a1-47a6-b3ae-a4d8a76bfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:36.362353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881beede-1d93-48e5-a9b4-286b5c0af1f4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.366991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 202/398] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:36.428068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807b3-4547-43ad-8472-903489e1fa27 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.428370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807b3-4547-43ad-8472-903489e1fa27 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.428626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807b3-4547-43ad-8472-903489e1fa27 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.430114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 203/399] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:36.439150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.439426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.439703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.467685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:36.469204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:36.483800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.512891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881beede-1d93-48e5-a9b4-286b5c0af1f4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.565099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 204/400] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:36.582450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.583124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.583396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.583660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.602150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:36.607946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:36.608819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:36.610020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 197/401] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:36.616821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.639096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.680433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.720811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4be2-cd64-41cd-9a7c-99b2464adde8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.755459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.756067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.756341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.756609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.757266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:36.757559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:36.759471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:36.767919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 205/402] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:36.773362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.853429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a61e24-6dc6-444d-91fc-d81007c5e38b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.855954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.878071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7f36-a702-472d-8e3a-64ef95b120ef None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:36.901138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.901783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.902061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.902330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.914255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:36.914783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:36.914988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:36.915257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:36.915525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:36.917732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:36.919199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:36.928651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 206/403] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:36.929709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:36.930793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:36.935512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:36.936391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:36.937177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:36.945739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 198/404] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:36.947338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.059734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8eec-0101-4505-8bd7-97b429a034c9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.079256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926db3e-626e-4beb-8e4e-c05128a8fac8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.095173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.095796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.096070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.096336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.097454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.098909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.100862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 207/405] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.101619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.115037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.115637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.115960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.116233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.117039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:37.117345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.119381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.125515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:37.129122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 199/406] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.129836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.191886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:37.207145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1a73c-76c1-4ab2-9c1b-4a603b9ff2b0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.236564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d9e6-95d1-496a-9c38-2c50e5b869dc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.241340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.242086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.242425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.242785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.253560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:37.258356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:37.259866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:37.261843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 208/407] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:37.270812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.278613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.279280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.279560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.279835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.281891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, group_id=39cb5d4caf644a5da4ac3470ba1952ef, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.283495 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.343461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:37.364229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad56924-6df1-4b27-88c3-aa034bc9622a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.399119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 200/408] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Aug 12 11:44:37 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:37.400688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.422452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.423137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.423416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.431267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.431267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.431267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858d0b4-395f-4574-99cb-dbcf0e6dd0cc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.431267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 209/409] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.432267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569767d-314e-4334-ad85-3f57497b2cbc None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.432764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569767d-314e-4334-ad85-3f57497b2cbc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.433222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569767d-314e-4334-ad85-3f57497b2cbc None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.434848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 210/410] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:37.439315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569767d-314e-4334-ad85-3f57497b2cbc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.578856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57919315-756c-4b44-84bb-9f1db792b8dc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.580697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569767d-314e-4334-ad85-3f57497b2cbc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.598103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:37.619096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.619719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.620007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.620257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.621381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.622822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888522-d002-493b-ae7a-49784af154bb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.629285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 211/411] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.629285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.629285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.629285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.643482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.644431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.644959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.645421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.645694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:37.646467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:37.646969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.647128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:37.648703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.657645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:37.662323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 201/412] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.663942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.723759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 212/413] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:37.723759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.807619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934dfe4-c549-4d58-8e5b-529dd7ae2540 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.878858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.879519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.879795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.880076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.884373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] RBAC: Authorizing `identity:create_grant(project_id=76650ff6f0f24292b99370acb7c5932b, group_id=39cb5d4caf644a5da4ac3470ba1952ef, role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.886071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.911769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6dc09-ba73-457e-bcd5-9e02f585dc5d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:37.949877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:37.950943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:37.951504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:37.952010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] PATH_INFO: `/v3/groups/4149c929e004435cae6ccb2de6c417dd` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:37.953338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] RBAC: Authorizing `identity:get_group(group_id=4149c929e004435cae6ccb2de6c417dd)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:37.955124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:37.957383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 213/414] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/groups/4149c929e004435cae6ccb2de6c417dd => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:37.963505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:37.972903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 202/415] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Aug 12 11:44:37 2022] PUT /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b/groups/39cb5d4caf644a5da4ac3470ba1952ef/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:37.988484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:38.091505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914e99-3447-4380-9cca-ec0ff6abbf07 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:38.120322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:38.150627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:38.151282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.151558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.151832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] PATH_INFO: `/v3/projects/65344c3d4d6c482091ff358a1b54d508` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.153047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] RBAC: Authorizing `identity:get_project(project_id=65344c3d4d6c482091ff358a1b54d508)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:38.154474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:38.156418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 214/416] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:37 2022] GET /identity/v3/projects/65344c3d4d6c482091ff358a1b54d508 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:38.162248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:38.173615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:38.275540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad3eb-4c76-4660-8c39-527957db6f8e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:38.295890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:38.317120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:38.317754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.318031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.318300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.319764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fd7d-740f-4fae-abf3-00d8d384723a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:38.330939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:38.336323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:38.338052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:38.339178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 203/417] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:38.346764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:38.379475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:38.380201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.380478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.380747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] PATH_INFO: `/v3/projects/65344c3d4d6c482091ff358a1b54d508/groups/4149c929e004435cae6ccb2de6c417dd/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.387823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] RBAC: Authorizing `identity:create_grant(project_id=65344c3d4d6c482091ff358a1b54d508, group_id=4149c929e004435cae6ccb2de6c417dd, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:38.389274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5128a-e502-48bf-aaea-63d0e08ad57a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:38.456971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:38.460197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa96da-910c-436c-bc69-2a544348b88c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:38.461432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Aug 12 11:44:38 2022] PUT /identity/v3/projects/65344c3d4d6c482091ff358a1b54d508/groups/4149c929e004435cae6ccb2de6c417dd/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:44:38.464647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947dc7-d1ae-451a-853b-4ae72ad0bae8 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.465241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947dc7-d1ae-451a-853b-4ae72ad0bae8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.465739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35947dc7-d1ae-451a-853b-4ae72ad0bae8 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.471612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 216/419] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:38.479074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.479714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.480259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.504561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:38.506340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:38.564685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:38.565310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.565581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.565848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.566542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:38.566846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:38.568263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:38.589948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 204/420] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:38.592151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:38.595817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:38.712246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2bef-d76e-4fb1-a711-4e1715077406 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:38.753586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:38.754203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:38.754475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:38.754771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:38.789634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:38.841150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:38.842620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:38.886941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.013009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.013192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 205/422] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:39.019022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.060685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3752ab8-c9f8-43cd-9394-3a52f31ba75f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.123216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb223-593d-4976-88b2-750461438498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.124416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb223-593d-4976-88b2-750461438498 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.125558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb223-593d-4976-88b2-750461438498 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.126194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fb223-593d-4976-88b2-750461438498 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.140107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.153084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fb223-593d-4976-88b2-750461438498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a96fb223-593d-4976-88b2-750461438498 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:39.168406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:39.169388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:39.170200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:39.171370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 218/423] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:39.179660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb223-593d-4976-88b2-750461438498 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.203782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273232-c836-4529-8833-ead7ca2cdd7b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.241101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.242105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.242673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.243712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.245071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.246752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:39.253214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 206/424] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:39.254717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.361278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daac74-6961-400e-b633-a8e5e2be0c29 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.368091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fb223-593d-4976-88b2-750461438498 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.396058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.397256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.398129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.398666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.399759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.401129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.402908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:39.410059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 207/425] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:39.412891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.432673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.440730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.441086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.441363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.441633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.442305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:39.442615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.443988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:39.462859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 219/426] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:39.474549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:39.521965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a6187-838f-47ca-80dc-cfd4d21506ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.560898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.561612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.561955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.562297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.563291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=99d3817650c94124af95280168a5c3e4) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:39.563667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.565507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537b44-f3c3-4c92-b284-c88cdde8cc07 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:39.579670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 208/427] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:39.589999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e2e0-c39e-461f-ac0a-a80e449bcffc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.590305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e2e0-c39e-461f-ac0a-a80e449bcffc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.590558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547e2e0-c39e-461f-ac0a-a80e449bcffc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.592320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 209/428] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:44:39.597917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.598192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.598464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.627985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:39.629145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:39.730324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6892d-b202-4b08-830c-2b6cce2bc3b1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:39.752866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.770613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 210/429] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:39.788359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:39.788978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:39.789253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:39.789522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:39.885696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:39.896133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:39.899699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.019517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 220/430] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 11:44:40.024924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.111244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.148516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641660-b7be-40c0-bca9-169d81483f9a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.186180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.187167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.187716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.187992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] PATH_INFO: `/v3/projects/99d3817650c94124af95280168a5c3e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.189780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] RBAC: Authorizing `identity:get_project(project_id=99d3817650c94124af95280168a5c3e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:40.191783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.193874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 211/431] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/projects/99d3817650c94124af95280168a5c3e4 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:40.199831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.222860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.233289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fd1b8-f0e1-4b0c-bcf1-ebba526715d5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.262735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.272093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.272734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.273009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.273282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.286711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:40.291693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:40.293181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:40.294398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 221/432] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:40.302033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.304992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b494-8038-4779-9497-93b6eeb539db None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.342315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.343004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.343280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.343552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.344697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:40.346139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa90b8-702d-4248-8180-76e22fd83252 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.348167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 212/433] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:40.351379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746556-3bd1-4b71-aaef-e43c70fef34a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.351664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746556-3bd1-4b71-aaef-e43c70fef34a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.351939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746556-3bd1-4b71-aaef-e43c70fef34a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.354139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 213/434] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:40.354876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746556-3bd1-4b71-aaef-e43c70fef34a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.418005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ce77c-3a2a-4373-a537-4ca912f6dc6f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.471727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.472758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.473044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.473587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.474495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:40.474839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:40.476884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8dc30-7bfb-4b15-a904-0c34b643fb3a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.479337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746556-3bd1-4b71-aaef-e43c70fef34a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.490669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 222/435] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:40.492023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.492381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.492851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.511374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.511548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:40.512801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:40.519396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=99d3817650c94124af95280168a5c3e4) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:40.524300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.525221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.529796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 214/436] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=99d3817650c94124af95280168a5c3e4&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:40.530787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.613272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 223/437] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:40.647856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d4653-c5c5-407f-bda7-ee804b315d88 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.685201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256948-70c9-427c-9232-284f626d195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:40.685753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256948-70c9-427c-9232-284f626d195b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:40.686027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256948-70c9-427c-9232-284f626d195b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:40.686294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f256948-70c9-427c-9232-284f626d195b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:40.747774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.757335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256948-70c9-427c-9232-284f626d195b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:40.758840 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f256948-70c9-427c-9232-284f626d195b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:40.862445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 215/438] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:40.868343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.878075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256948-70c9-427c-9232-284f626d195b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:40.976761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:40.983234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adcf5c-e161-4073-aa37-03c0635b6f7f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:40.985334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f256948-70c9-427c-9232-284f626d195b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.016279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.016908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.017187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.017456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.018544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.018925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.019544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.019823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.019966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b84c7-d89c-4d7a-aa9a-d191fc9ae5c1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.020093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.021569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 224/439] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:41.022682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55da78-15f9-4c08-abfd-a986690db892 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.022959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55da78-15f9-4c08-abfd-a986690db892 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.023226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55da78-15f9-4c08-abfd-a986690db892 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.025083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 225/440] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:41.029663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55da78-15f9-4c08-abfd-a986690db892 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.030921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-131e5a24-a4eb-4e05-8a2a-bede50877416 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:41.035535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:41.036597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:41.037557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 216/441] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:41.040316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.040600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.040869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.045651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.058138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:41.059353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:41.123539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 217/442] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:41.124343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.139874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55da78-15f9-4c08-abfd-a986690db892 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.176142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.176771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.177054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.177331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.178424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.180081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.186466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 226/443] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:41.187414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.209133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.227771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a22b5-0a3c-4bc7-95d1-40fbcf6af9ca None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.263518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.264122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.264396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.264671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.265338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:41.265633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.267120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.271981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.280950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 218/444] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:41.281899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.296051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e363b53-7682-4bfa-8936-a1aa21b3a762 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.332049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.332648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.332926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.333195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.333914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=6c5390de52524fd1ab2f9f4d74b70761, scope.project.id=76650ff6f0f24292b99370acb7c5932b) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:41.334218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.335665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.350545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 227/445] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=6c5390de52524fd1ab2f9f4d74b70761 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:41.388122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.395666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f07d7f-a24b-4547-a99f-2df5735036e2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.434289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.434937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.435212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.435480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.457430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.502683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb8f13-cdfb-4c35-965d-862e38d190dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.524213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.525663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.539687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.540312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.540588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.540853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.551255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:41.558131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:41.559130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:41.560400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 228/446] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:41.564917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.568585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.647493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 219/447] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:41.653397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.681110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad2b1-ac9d-46df-a2e2-6ba2f96aaa2a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.706007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.719273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.719884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.720159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.720430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.721083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:41.721381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.722823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.730732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 229/448] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:41.736344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.761406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930602-c415-47f4-9bd8-0d4d23d2fda3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.793167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.793779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.794054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.794322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] PATH_INFO: `/v3/projects/76650ff6f0f24292b99370acb7c5932b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.795457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] RBAC: Authorizing `identity:get_project(project_id=76650ff6f0f24292b99370acb7c5932b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.796872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.798501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 220/449] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/projects/76650ff6f0f24292b99370acb7c5932b => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:41.801150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.803889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:41.837011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1083-76c7-4385-bf12-98677cd7cd62 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.872397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.873009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.873287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.873561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.907453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31626-9076-4143-bb0a-37a1f926cb20 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:41.920307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:41.940948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:41.941565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:41.941847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:41.942115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] PATH_INFO: `/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:41.942749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.943263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] RBAC: Authorizing `identity:get_group(group_id=39cb5d4caf644a5da4ac3470ba1952ef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:41.944195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.944689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:41.946420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 221/450] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/groups/39cb5d4caf644a5da4ac3470ba1952ef => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:41.952009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:42.011787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:42.047290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 230/451] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:42.052891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:42.054303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b705a7-933d-48cf-822f-a8e4464514fc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:42.088506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:42.089104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:42.089385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:42.089659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:42.090386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] RBAC: Adding query filter params (group.id=39cb5d4caf644a5da4ac3470ba1952ef, role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=76650ff6f0f24292b99370acb7c5932b) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:42.090732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:42.092157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:42.097734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 222/452] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:41 2022] GET /identity/v3/role_assignments?group.id=39cb5d4caf644a5da4ac3470ba1952ef&scope.project.id=76650ff6f0f24292b99370acb7c5932b&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:42.154796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451ebc-28f5-4064-b158-34b74d77e994 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:42.190475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:42.191147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:42.191435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:42.191714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] PATH_INFO: `/v3/projects/65344c3d4d6c482091ff358a1b54d508` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:42.192854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] RBAC: Authorizing `identity:get_project(project_id=65344c3d4d6c482091ff358a1b54d508)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:42.194309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:42.196074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 231/453] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:44:42 2022] GET /identity/v3/projects/65344c3d4d6c482091ff358a1b54d508 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:42.201801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:42.250694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:42.307217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47afe-50ce-441d-a535-7dd67d27de42 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:42.339819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:42.340446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:42.340720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:42.340993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] PATH_INFO: `/v3/groups/4149c929e004435cae6ccb2de6c417dd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:42.342086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] RBAC: Authorizing `identity:get_group(group_id=4149c929e004435cae6ccb2de6c417dd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:42.343535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9a252-eff5-462a-a0bc-604b08ae20ba None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:42.345076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 223/454] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Aug 12 11:44:42 2022] GET /identity/v3/groups/4149c929e004435cae6ccb2de6c417dd => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:42.350965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:42.386094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:42.453630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8b30-cf38-44f0-bb71-f1faa2dbc2ee None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:42.488086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:42.488689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:42.488969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:42.489243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:42.489956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] RBAC: Adding query filter params (group.id=4149c929e004435cae6ccb2de6c417dd, role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=65344c3d4d6c482091ff358a1b54d508) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:42.490262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:42.491734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85137806-31b2-4e6f-a7a8-73b375518d6b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:42.497288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 232/455] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Aug 12 11:44:42 2022] GET /identity/v3/role_assignments?group.id=4149c929e004435cae6ccb2de6c417dd&scope.project.id=65344c3d4d6c482091ff358a1b54d508&role.id=5540f9b1011544929fd18ae216a070b0 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:44.710360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758ede-f114-424a-bec1-b78829a03c5a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:44.710887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758ede-f114-424a-bec1-b78829a03c5a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:44.710960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758ede-f114-424a-bec1-b78829a03c5a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:44.712614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 224/456] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:44.717736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781b7b-1634-44ed-aadb-4a9e51e6ef7f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:44.718137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781b7b-1634-44ed-aadb-4a9e51e6ef7f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:44.718213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781b7b-1634-44ed-aadb-4a9e51e6ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:44.743911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-25781b7b-1634-44ed-aadb-4a9e51e6ef7f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:44.745110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-25781b7b-1634-44ed-aadb-4a9e51e6ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:44.828447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 233/457] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:44.993319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f038e-fd19-4550-9340-8a129ef20ad3 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:44.993620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f038e-fd19-4550-9340-8a129ef20ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:44.993796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f038e-fd19-4550-9340-8a129ef20ad3 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:44.995465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 225/458] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:45.000473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f94b7-491c-4859-83af-8e829e463422 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.000766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f94b7-491c-4859-83af-8e829e463422 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.001047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f94b7-491c-4859-83af-8e829e463422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.027485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-744f94b7-491c-4859-83af-8e829e463422 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:45.028684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-744f94b7-491c-4859-83af-8e829e463422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:45.057208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.113130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 234/459] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:45.176815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f038e-fd19-4550-9340-8a129ef20ad3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.255867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330bb1c-65d2-468a-986c-485d88e1f1a3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.256162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330bb1c-65d2-468a-986c-485d88e1f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.256362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330bb1c-65d2-468a-986c-485d88e1f1a3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.258150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 235/460] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:45.263465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.270730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.270730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.296810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:45.298017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:45.315190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f038e-fd19-4550-9340-8a129ef20ad3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.329164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.366850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.367522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.367802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.368076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.369441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 236/461] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:44:45.391372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.392831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:45.415960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:45.418007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:45.420038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:45.420038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.420038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:45.420038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 226/462] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:45.426271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.514366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.524898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.537655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6270-ce94-4dea-8cab-ea063b192d2f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.574423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.575069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.575348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.575620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.576265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:45.576629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.578727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.592975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 237/463] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:45.598471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.679248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969900e6-765e-42f0-9111-de1049d91937 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.714563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.715223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.715461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.715733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.727215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.728678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.740872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f2481-e855-4a52-85f3-6f0e036634ec None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fd3a6fd9-f04f-45de-98eb-b31bfb449ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:45.742949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:45.743820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:45.744667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:45.744667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.744667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:45.744667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 227/464] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:45.745278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324053b-0751-4005-9327-31662cea358e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.745524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324053b-0751-4005-9327-31662cea358e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.745802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324053b-0751-4005-9327-31662cea358e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.747191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 228/465] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:45.747833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324053b-0751-4005-9327-31662cea358e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.770762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.784153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.784818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.785096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.785366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.785991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.792209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.859255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324053b-0751-4005-9327-31662cea358e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:45.892135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:45.892750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.893024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.893288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.903980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:45.905430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:45.914614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 238/466] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:45 2022] POST /identity/v3/users => generated 246 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:45.914614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:45.924181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-adfd9e53-6d9f-4072-8a6a-0176b7c5dbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:45.932069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:45.933029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:45.933933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:45.933933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:45.933933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:45.941444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 229/467] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:45.941444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:45.941444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:45.941444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:45.973856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:45.976099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:46.046750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef7ad9-61e5-44b6-bd1f-543a83a171b7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.066116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:46.074101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 230/468] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:46.074915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.090346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.091385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.091890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.092354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.093195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:46.093736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.095404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.111790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 239/469] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:46.116949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.187176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:46.194145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9486c6-b390-4810-a19f-2cc6647335a7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.228818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fe28a-ef82-4266-9f3f-b312b28be2b8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.230543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.231222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.231556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.231766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.232396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:46.232692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.234059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.252710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 231/470] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:46.258882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.271895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.272816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.273301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.273874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.274738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.276350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.325409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:46.369294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f967-f128-432e-bf55-b95f18ebc5c8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.404769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.405377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.405650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.405917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.406574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.408049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac275-4f5b-4304-a77e-1c0b2590df95 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.443747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 240/471] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:46 2022] POST /identity/v3/users => generated 248 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:46.450675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.524199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 232/472] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:46 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:44:46.525549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4ac9-e54a-4e20-bd2e-b1c2067c4cd8 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.525838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4ac9-e54a-4e20-bd2e-b1c2067c4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.526106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4ac9-e54a-4e20-bd2e-b1c2067c4cd8 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.528058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 233/473] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:46.535424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.535767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.535958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.557256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:46.558547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:46.597553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528a4e-b1a3-4b0d-aac0-07189e4c4e61 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.622283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:46.645058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.645727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.646003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.646270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.665021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 234/474] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:46.667671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.671295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:46.695951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:46.696935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:46.698071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:46.698071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:46.698071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:46.698071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 241/475] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:46.702945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.753485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:46.811374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1526f-9209-45db-9797-cfc5fd4be6ad None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:46.847822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:46.848354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:46.848629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:46.848896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:46.849659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:46.849957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:46.851390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:46.864466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 235/476] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:46.870637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.955839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:46.974997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc286b-b208-4d17-bf01-0afacd765e06 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:47.018554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:47.018554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.018554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.018554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.018971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:47.018971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:47.091336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed43b8-7777-49d1-b4a6-938db95de850 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:47.093763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:47.109708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 242/477] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:46 2022] POST /identity/v3/users => generated 249 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:44:47.137891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:47.138632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.138915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.139186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.139908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:47.141920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:47.187134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.sql.core [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:44:47.187134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 11:44:47.187134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [parameters: {'id': '5369540f6c674e8d8e24080d69b74713', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 11:44:47.187134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81657) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:44:47.205272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return ref.to_dict() Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:44:47.206238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application yield resource Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise self.value Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application session.commit() Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:44:47.207572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:44:47.208434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:44:47.209311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:44:47.210111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [parameters: {'id': '5369540f6c674e8d8e24080d69b74713', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:47.210998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 11:44:47.213084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:47.214738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 236/478] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Aug 12 11:44:46 2022] POST /identity/v3/roles => generated 144 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:47.217391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:47.258410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:47.339880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e89ea-5058-4333-9bdd-7a6263c80787 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:47.380237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:47.380806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.381083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.381355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.398946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7782d858-1cc5-460c-a4fa-9f4bbd2132d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:47.403774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:47.404660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:47.406042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 243/479] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:47.410485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:47.530586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60e418-e41c-4b83-814c-9befc13c2c3d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:47.567934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:47.568542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:47.568875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:47.569154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:47.569817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:47.570117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:47.571655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1902e6-3070-485e-9c57-57fbbf32fdaa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:47.580277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 237/480] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:48.324317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e266-1d38-4af2-8618-69790bf3ee51 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:48.325316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e266-1d38-4af2-8618-69790bf3ee51 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:48.325941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e266-1d38-4af2-8618-69790bf3ee51 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:48.327789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 244/481] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:48.333517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:48.334319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:48.334824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:48.362731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:48.364254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:48.391301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:48.442668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 238/482] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:48.752327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e266-1d38-4af2-8618-69790bf3ee51 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:48.850978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:48.865291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e266-1d38-4af2-8618-69790bf3ee51 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:48.903152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:48.903791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:48.904073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:48.904348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:48.915661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6cea3494-5288-48bc-a55f-fcb76b89d39b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:48.920402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:48.921282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:48.922083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 245/483] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:48.928887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:48.974962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8ff7-b6d6-4d7b-b30e-4f6db872636b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:48.975304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8ff7-b6d6-4d7b-b30e-4f6db872636b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:48.975676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d8ff7-b6d6-4d7b-b30e-4f6db872636b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:48.977903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 246/484] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:48.983695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0c45-1abb-4dd3-8713-c62cc3fae6dd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:48.983974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0c45-1abb-4dd3-8713-c62cc3fae6dd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:48.984238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0c45-1abb-4dd3-8713-c62cc3fae6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.018622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c81f0c45-1abb-4dd3-8713-c62cc3fae6dd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:49.018622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c81f0c45-1abb-4dd3-8713-c62cc3fae6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:49.078272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e112fd-bd8c-4af7-ac47-3b85ec875264 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.116384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.118394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.118884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.120002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.120861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:49.121877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:49.123645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:49.129311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 247/485] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 12 11:44:49.140932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 239/486] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:49.146711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.147015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3122fb-b91c-4c99-94a7-f9fb39af5fe2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.147312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3122fb-b91c-4c99-94a7-f9fb39af5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.147590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3122fb-b91c-4c99-94a7-f9fb39af5fe2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.149782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 248/487] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:49.155050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.155331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.155624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.174304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:49.175519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:49.190481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.295618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 249/488] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:49.313522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc84526-67a0-402d-a0db-f93fcb313cea None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.373497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.374293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.374603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.374880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.395434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:49.396897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:49.418191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:49.419180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:49.420020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:49.420020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:49.420020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:49.420020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 240/489] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:49.426205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.437528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.477782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.572097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.595644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d21b8-c729-42c7-9d4d-02ba91c6a253 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.604685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0206235-1a68-448b-88b4-d5b35ab31d23 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.639693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.640322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.640604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.640886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.641552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:49.641820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.641957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:49.642751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.643172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.643282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f621c8-ecaa-41d0-b320-152d09e97475 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:49.643689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.657374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:49.661945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 250/490] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:49.661945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8aa8-e9b9-400f-a1d9-ae1a0ab4ff8c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.662130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8aa8-e9b9-400f-a1d9-ae1a0ab4ff8c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.662340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8aa8-e9b9-400f-a1d9-ae1a0ab4ff8c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.663571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 251/491] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:49.664360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f8aa8-e9b9-400f-a1d9-ae1a0ab4ff8c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:49.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:49.667407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:49.668209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:49.669039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 241/492] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:49.669839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.735342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.771004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f8aa8-e9b9-400f-a1d9-ae1a0ab4ff8c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.782415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca92d8-f1f8-47aa-8433-11f4f0572c55 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:49.806904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.807533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.807813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.808088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.818160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:49.818449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:49.818811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.819086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.819354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.823520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ef803470-7f86-4a48-8c06-034e387f23b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:49.824168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:49.825090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:49.825898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 252/493] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:49.826598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:49.827355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:49.827355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:49.839181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:49.840635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:49.847904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:49.849100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:49.853276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:49.854156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:44:49.855722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:49.859049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 242/494] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:49.859896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.921068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 253/495] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:49.921931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:49.988269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:49.998897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b22ec7-a146-4162-bee1-57ec4ba4f791 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.040746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dd1a2-941a-49ce-9d53-f2a29da574f0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.048285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.048891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.049167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.049436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.050111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.050412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.051833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.065393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 243/496] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.066336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.083913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.084432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.084684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.084955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.085664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.085997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.087550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.100758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 254/497] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.102111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.142478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.206725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a38b5-340c-4175-9a52-aca54f2433f9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.212841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11220422-2164-4986-8d10-9bc3b3ded940 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.235291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.244099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.244709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.244992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.245261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.245998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.247692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.247796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.251021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.251808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.252227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.252658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.263971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.265732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:50.287532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:50.288825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:50.290536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:50.290536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:50.290536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:50.291930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 255/498] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:50.292911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.293788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 244/499] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.294598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.401661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fdc3-c114-49f2-9053-502281bae56d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.405589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea865003-a6ed-4460-815e-594ac70e4ef6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.422172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.435083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.445368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.445368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.445368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.445636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.445636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.445636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.445636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.446847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.448306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.454022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:50.459686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:50.460690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:50.461526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 245/500] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:50.462679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:50.462747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:50.463548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:50.464372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:50.464372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:50.464372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:50.464372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 256/501] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:50.464974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.490052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.563905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980caa0-7d9a-4a2f-8bc5-cf1b0494c0d7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.564487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdaaf1-fc5d-4548-8325-0c1267418dd7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.598899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.599482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.599914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.600088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.600367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.600454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.600637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.600847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.602601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.603127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.604501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82d4f-7784-44bd-acbf-541464d5c5a7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.616591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 257/502] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.617817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efa26-114f-4f68-b5d5-3995c4b83a26 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.618101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efa26-114f-4f68-b5d5-3995c4b83a26 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.618375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00efa26-114f-4f68-b5d5-3995c4b83a26 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.619584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 258/503] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:50.620332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00efa26-114f-4f68-b5d5-3995c4b83a26 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.647124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.671900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.673283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.706171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.722671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00efa26-114f-4f68-b5d5-3995c4b83a26 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.755430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.756028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.756299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.756567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.757217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.757513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.758901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.766996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 259/504] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.767773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.771187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 246/505] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:50.772157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.844324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.864607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de218dd-e925-4778-a985-e60545e733f5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.869032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa94c9-ab2c-4119-8912-7a0b8e70deec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:50.899958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.900558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.900837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.901108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.901741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:50.902040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.903454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebf1b3-03c9-4fb6-b8a6-6128fcb2ad8b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.903569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:50.904111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.904390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.904668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.911670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:50.913105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:50.915381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 260/506] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:50.916360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:50.916643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:50.916913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:50.925106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:50.926001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 247/507] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:50.926945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:50.928731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:50.934607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:50.935840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:51.001360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 261/508] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:51.002660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.028841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458a4-7e0f-4a4a-a808-b0d39ad4e5c2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.064206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.064823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.065097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.065363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.067415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.077290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.078804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:51.093068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:51.093985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:51.094900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:51.094900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.094900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:51.094900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 248/509] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:51.095584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.117203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f9584-c7a0-41c3-a8ed-a2cd01c85b67 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.156578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.157237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.157515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.157787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.160805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.168455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.170349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:51.186216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:51.187372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:51.188664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:51.188664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.188664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:51.189061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 262/510] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:51.189863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.213689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e19a87-2716-4341-941f-1fd1e2d0f9d1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.249777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.250409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.250719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.250994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.261629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.263241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:51.274887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:51.275920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 249/511] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:51.277001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.296215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab12a2-d82d-44d0-bc6f-3f6951a61825 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.324175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.330356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.330984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.331261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.331530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.332250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:51.332586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.333980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.369159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 263/512] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:51.369964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.377852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd362eb-4ded-460b-bf40-c7d388e6e297 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.410965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.411567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.411829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.412099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.412739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:51.413038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.414432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.422275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.425927 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 250/513] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:51.426728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.476158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4cdb0-1362-4f4b-81c0-e6a21e76334f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.510730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.511321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.511594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.511861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.512499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:51.512793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.514151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.524008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b197-72e8-4f14-ad8e-3f0afbb2b9b6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.529950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 264/514] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:51.529950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.531527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.557535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.558161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.558440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.558748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.569144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.571228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:51.585202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:51.586113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:51.586998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:51.586998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:51.586998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:51.586998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 251/515] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:51.587231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.627697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b50b-8273-4362-80d1-e705c9e78527 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.639156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.665328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.665940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.666214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.666485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.667233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:51.667536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.668960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.683919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148864-3c35-48c8-b23a-644c3ddcfa77 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.686663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 265/516] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:51.687435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.716557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.717158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.717431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.717696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.744886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.783657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.783869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312e89d-2bdd-4a47-9ada-916095c2fcae None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.785218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.817454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.818070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.818350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.818647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.825364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.826825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:51.840776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:51.842566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 266/517] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:51.844573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.872365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.893194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 252/518] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:51.894072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:51.950427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772c48-4204-402b-a517-8d0cdc29941a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.952396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:51.983838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:51.984459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:51.984738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:51.985007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:51.991369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:51.993039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d482fca-80a6-442c-b332-7baaf8746e46 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:51.993468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:52.004793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:52.005828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 267/519] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:52.006723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.031898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.032489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.032767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.033032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.033663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:52.033958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.035352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.047232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 253/520] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:52.048031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.093144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.109032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42856755-88cd-4cc9-b171-791c2f185f8f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.141632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.142232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.142507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.142803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.145176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5404-c688-47af-a3aa-d9b5b001ebb1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.162903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.179652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.180249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.180526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.180798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.181520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:52.181825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.183283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.200128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 254/521] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:52.200912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.215081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.216549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.298550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345940-2699-4f17-8e7a-4eca8cc68c65 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.299184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.314911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 268/522] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:52.315704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.331385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.332004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.332280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.332547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.343157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.344605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:52.359087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:52.359982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:52.360866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:52.360866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:52.360866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:52.360866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 255/523] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:52.360866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.389940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.417192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eeb27-ba84-46d2-b739-5029b539b382 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.453542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.453542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.453542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.453542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.453966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:52.453966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.455117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.463886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6a977-d9c2-469c-8f0b-eb0bca22f356 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.473206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 269/524] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:52.473886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.502313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.502952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.503234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.503509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.504148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.505601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.517771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.568636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b42a4-4794-4018-aef6-d2701d5705af None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.582488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 256/525] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:44:52 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:44:52.583321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.602825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.603461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.603737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.604009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.682657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.684821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.691285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.708789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a529d-d7bb-4f18-bfa3-744aa9dc522e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.734649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.749978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.750651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.750935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.751208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.763366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.764858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:52.783008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:52.784039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:52.784894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:52.784894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:52.784894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:52.784894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 257/526] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:52.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.793806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 270/527] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:52.794599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.889413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6934aa3-ad32-4cd8-8dcc-11be6356ac12 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.900833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09ccd-f9d5-4f58-87cb-3f9decc4afea None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:52.926332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.927097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.927378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.927643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.928282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:52.928576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.930629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.933395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:52.937217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:52.937821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:52.938547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:52.938547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:52.939107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:52.939413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:52.940830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:52.948558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 258/528] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:52.948558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.948774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 271/529] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:52.948774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:52.960318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.058347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6deb-56ef-472e-82b4-376e5f40f87a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.064412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813253cd-8e3b-4f5e-bd0d-9ad48c203a8e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.097726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.098360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.098667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.098938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.109340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.109897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.110022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.110360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.110742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.111368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.111470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.111836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.113266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.126219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 259/530] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:53.126806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:53.127711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:53.129075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:53.129075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:53.129075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:53.129288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.129369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 272/531] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:53.131126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.193882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.204639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.236264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37752cfb-49df-497d-8300-34835a50cd52 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.263973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db9b2f-82c6-4a87-a39e-64ac2c340c81 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.273900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.274677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.275050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.275413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.282860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.284425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:53.297253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:53.298308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.299384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:53.300967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 273/532] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:53.302032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.308392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.309222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.309641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.310082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.319405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.321997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:53.339052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:53.340101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.341168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:53.348506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 260/533] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:53.348506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.415373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d488-d8f5-4323-9dc8-47bd8052be85 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.435226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.451815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.452354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.452627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.452898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.456041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.456384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.457859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.471720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 274/534] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:53.471720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.488306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6322d9f-4a6b-4b3b-a3f6-0a9666ac893f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.511383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.534132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.535009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.535702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.536116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.537240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.538097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.540273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.564899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 261/535] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:53.566441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.586068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1adc1c-82d1-42b1-b456-cc4c256f6e4e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.624392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.625150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.625581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.625951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.626836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.627237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.628936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.646586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 275/536] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:53.646586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.691248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.705423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975aeea-5923-4b10-9a83-fb9b06649e72 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.753630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.753852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329816-4992-44a7-a191-163dda34a2bc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.754646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.755091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.755756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.765523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.767872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:53.783458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:53.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:53.785530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:53.792647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 262/537] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:53.792647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.801556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.802413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.802912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.803789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.805609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=0fb6edf322d64dad81ac0bca7a1c32c3) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.806067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:53.808238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:53.816487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 276/538] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/role_assignments?user.id=0fb6edf322d64dad81ac0bca7a1c32c3&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:53.817933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:53.830957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.936569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d18e-b052-40d2-b120-ad2fcad1325e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.955343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48ae6a-c2da-4771-9146-17bdbcb434e3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:53.958465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:53.995768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:53.997481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:53.997766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:53.998038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:53.998782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:53.999069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:54.000494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:54.011200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:54.012098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:54.012564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:54.013019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:54.013474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 277/539] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:54.014171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=971fc696d71f4812bf3e50bafb3871a0) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:54.014695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:54.016371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a9f8c-3614-4186-971e-2d097c0d30cd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:54.019131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:54.023211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 263/540] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:53 2022] GET /identity/v3/role_assignments?user.id=971fc696d71f4812bf3e50bafb3871a0&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:54.149376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf8a3-240c-469a-9de9-5b953e9b1d17 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:54.189783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:54.190404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:54.190703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:54.190974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:54.191706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=4a8a0dbe3ac0405c876c1a07f500bd7f) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:54.192014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:54.193453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a584da8-c862-4424-b8ea-e3d884fe512b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:54.204200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 278/541] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:54 2022] GET /identity/v3/role_assignments?user.id=4a8a0dbe3ac0405c876c1a07f500bd7f&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:54.702165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead1fa-dbdf-423d-bd85-61e65cfd321d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:54.703202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead1fa-dbdf-423d-bd85-61e65cfd321d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:54.703680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead1fa-dbdf-423d-bd85-61e65cfd321d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:54.705216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 264/542] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:54.713348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5f70-99ca-4a7d-acef-aefa5305c045 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:54.713762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5f70-99ca-4a7d-acef-aefa5305c045 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:54.713939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c5f70-99ca-4a7d-acef-aefa5305c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:54.743618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-213c5f70-99ca-4a7d-acef-aefa5305c045 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:54.744744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-213c5f70-99ca-4a7d-acef-aefa5305c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:54.773019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:54.832918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 279/543] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:55.018378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa6b3-bcb2-43a2-9d49-5f603e7095e6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.018729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa6b3-bcb2-43a2-9d49-5f603e7095e6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.018900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa6b3-bcb2-43a2-9d49-5f603e7095e6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.020423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 265/544] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:55.026330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.026645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.026923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.046982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:55.048169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:55.135778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 280/545] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:55.162071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa6b3-bcb2-43a2-9d49-5f603e7095e6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.264378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:55.273471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa6b3-bcb2-43a2-9d49-5f603e7095e6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:55.305958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:55.306633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.306910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.307229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.318854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:55.323811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:55.324698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:55.325485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:55.328377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 266/546] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:55.334208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.478504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:55.491006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d79c-022a-47e6-a8e6-83a924d36a02 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:55.526076 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:55.526946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.527631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.528040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.528841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:55.529300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:55.530822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:55.539736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 281/547] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:55.546151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.546289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.664594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc9176-4b29-4305-997d-c7c33c682655 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:55.704638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:55.705772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.706256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.706762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.719692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:55.726102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:55.727005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:55.727896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:55.731012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 282/548] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:44:55.736952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.764595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:55.806816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9e10-b94b-422a-88db-efc7796bd7d6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:55.869955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:55.871222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:55.871727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:55.872205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:55.883878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:55.885967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:55.903157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:55.904309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:55.905181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:55.905181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:55.905181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:55.908223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 267/549] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:55.914367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:55.932656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:55.982303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abdd3e-dbbd-4a3a-bc4e-7349c11473cd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.031307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8f10e-ee20-4933-adf1-224303caaac2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.080165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.081598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.082422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.083287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.083924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.084410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.084876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.085356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.086244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:56.087320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.087677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:56.089463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.089794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.091450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.108855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 283/550] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:56.111385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 268/551] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:56.117579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.118888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.197290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.228185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb30cc-f8be-4bf8-aa61-174add6f3cd0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.252114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.264226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.264863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.265139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.265410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.273880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.275367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:56.287009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:56.287964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:56.289448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 269/552] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:56.296219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.312599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27333ed8-571d-4c5d-adbc-daf6a7e93f01 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.347244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.347875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.348156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.348426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.359982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.361430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-9d04448c-2bf4-4481-b148-9b681b8055ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:56.376544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:56.377620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:56.378552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:56.378552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:56.378552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:56.382308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 284/553] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:56.383593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99354-ceab-4ce7-9da8-c5cfb2f711ee None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.383877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99354-ceab-4ce7-9da8-c5cfb2f711ee None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.384149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99354-ceab-4ce7-9da8-c5cfb2f711ee None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.385802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 285/554] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:56.386363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99354-ceab-4ce7-9da8-c5cfb2f711ee None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.409428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5dff1-0880-472c-83fd-f445e93d2d71 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.443443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.455144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.457340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.457340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.457340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.457555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:56.457843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.459323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14964a2-e3a4-4124-a449-05915d28b903 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.480611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 270/555] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:44:56.483830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.484295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.485276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.499362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99354-ceab-4ce7-9da8-c5cfb2f711ee None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.504177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:56.505532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:56.522612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.533930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.534558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.534847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.535122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.535764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:56.536064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.537439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab243c7-5bb6-4cdf-a969-5d51b588b61f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 286/556] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c5c-36f9-442a-9512-d37a1cfeddcf None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c5c-36f9-442a-9512-d37a1cfeddcf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c5c-36f9-442a-9512-d37a1cfeddcf None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 287/557] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:56.554469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540c5c-36f9-442a-9512-d37a1cfeddcf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.588446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 271/558] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:56.589689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.707686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a11d-c972-46cc-b7a6-c5e793b6eb61 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.708384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540c5c-36f9-442a-9512-d37a1cfeddcf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.728944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.743491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.744091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.744367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.744634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.744914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:56.745515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.745794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.746066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.751992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.753539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2da85ac6-294c-44c7-9e11-5dc922a47bdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:56.765909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:56.767548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:44:56.768615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:56.775710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 272/559] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:56.775710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d76a2-933e-409f-9b77-325261f5a616 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.775710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d76a2-933e-409f-9b77-325261f5a616 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.775710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d76a2-933e-409f-9b77-325261f5a616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.791779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2a5d76a2-933e-409f-9b77-325261f5a616 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:56.792978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2a5d76a2-933e-409f-9b77-325261f5a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:56.801483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:56.818637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:56.820730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 273/560] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb511a7-ec2b-4aca-9f1d-d33002cbdd4f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb511a7-ec2b-4aca-9f1d-d33002cbdd4f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb511a7-ec2b-4aca-9f1d-d33002cbdd4f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 274/561] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:44:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:44:56.867142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb511a7-ec2b-4aca-9f1d-d33002cbdd4f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.934225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 288/562] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:44:56.935468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:56.981204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb511a7-ec2b-4aca-9f1d-d33002cbdd4f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:56.992922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.018010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.018645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.018951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.019223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.019945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:57.020243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.021307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.021649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad92f1-9d78-4966-9e27-cb851cb3027e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.039772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 275/563] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:57.047453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.047453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.047453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.047737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02acff-a721-42ff-a490-8321eefd869d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.059163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:44:57.060336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:44:57.086937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.087667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.088018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.088365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.099787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:57.104979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.105959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 289/564] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.106886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.137319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 276/565] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:44:57.138260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.224887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263ae49-3357-4a7b-81cf-25dd2906c084 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.248871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.252974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e67639-21bf-4484-b6d9-129edfd9ce44 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.261536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.262241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.262583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.262859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.274030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.275488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.278476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:57.291230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.292204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:57.293101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:57.293101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.293101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:57.293274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.293274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.293274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.293274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.297009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 290/566] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.297847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.303935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.305467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:57.319654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.320781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:57.321897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:57.321897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.321897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:57.322783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 277/567] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.323570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.425131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a068b-1d01-4b08-85a3-642c4baa0192 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.450087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55314c3-0a25-4d72-8dc3-bbe362a3e4f0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.457845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.458473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.458788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.459054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.469770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:57.474884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.475904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:57.477294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 278/568] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.477987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.489441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.489863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.490037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.490546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.490673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.491247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:57.491542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.492889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.500978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 291/569] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:57.501680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.558211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.578164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b916c-ae1e-4909-b256-9d73374ba61b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.600165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0a210-1d33-4e79-9cb9-61a8fec80330 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.611812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.612414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.612691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.612961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.613627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:57.613929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.615568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.627329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 279/570] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:57.628571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.634562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.635216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.635643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.635979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.636621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:57.636920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.638264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.650546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 292/571] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:57.651438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.700301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.730134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4214-f6da-4a1d-a75c-84d9988b8eca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.746069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b485d-425c-4f27-9d79-c823e5ab35df None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.763258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.763990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.764606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.764885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.765153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.775797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:44:57.779540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.780129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.780402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.780671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.781316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:57.781616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:44:57.781991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.782924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:44:57.783772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:57.784407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 280/572] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.784478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.796654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 293/573] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:57.796654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.883344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b665de-01f4-4772-bb8c-c0e89ffd2108 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.891737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e98e2-46ce-4d9c-a1a0-93e641e56801 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:57.914094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:57.919617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.920235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.920510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.920777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.925716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:57.928389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:57.928389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:57.928389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:57.930632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.932078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.933678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:57.935174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:57.946450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.947366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:57.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:57.948700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:57.949591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:57.950482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:57.950482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:57.950482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:57.950701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 294/574] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.950771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 281/575] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:57.950837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.950913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:57.992212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.047265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14628-a9e1-4c5c-8cb4-6072cc41e122 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.047684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259a420-ed97-47b4-a5ef-9854718a7b7d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.079467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.079891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.080064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.080340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.080498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.080610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.080772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.081038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.081261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.081558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.082951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.088339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.089549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.090613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 282/576] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.092257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:44:58.106961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:58.107902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:58.108923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 295/577] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:58.109568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.142244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.194400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf52d-1dc3-42f3-a982-fc054971241e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.206706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.209500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda70050-1a10-4193-b97d-9e9d8fbcda9b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.228315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.228938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.229215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.229486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.239805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.241234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.242213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.242838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.243110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.243405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.244086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.244383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.245778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:58.255601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:58.256539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:58.258024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:58.258024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:58.258024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:58.258024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 283/579] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:58.258260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 296/579] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.258260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.258386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.349090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.355289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6a51-15b2-4595-92ea-2dffe95f7553 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.358869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b437395-ed70-4394-83a9-49f01bcf7bea None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.388584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.389187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.389464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.389733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.390370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.390703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.391466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.392071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.392167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.392346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.392618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.402930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.403064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 284/580] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.403722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.404358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:58.420309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:58.421369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:58.422264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:58.422264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:58.422264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:58.422264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 297/581] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:58.422264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.436617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.509802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47828a6-989f-4601-8948-4cd19a644a8c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.519187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe28e2-243a-45c2-a19e-021894a41f57 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.542448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.543071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.543341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.543605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.544283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.544580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.545983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.552261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.552853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.553129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.553397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.554756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=fae4b6d2e7f5478495814d5f392b2b27) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.555068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.556464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.558033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 285/582] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.558832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.562138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 298/583] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/role_assignments?user.id=fae4b6d2e7f5478495814d5f392b2b27&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.563131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.585891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.649297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.674059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5010a-4b6a-42f6-9a2d-30ff8f0bf2dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.674574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba92d4e-483a-4203-88a5-128c0278c9c1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.711613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.711935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.712222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.712495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.712613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.712766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.712869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.713053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.713689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.713986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.715803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.720739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.722163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.732934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 286/584] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.732934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:58.738800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:58.739927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:44:58.741119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:44:58.747743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 299/585] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:58.747743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.817420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.842963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab33eb9-ea0d-42a4-9db6-18c7d428f36c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.844039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445ff0-c9cc-4139-91cb-fa905fdbe7ac None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:58.879645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.880401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.880604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:58.880788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.881122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.881445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:58.881786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:58.881905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:58.882205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:58.882364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.883817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.885963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:58.901142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 287/586] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:58.901142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:58.903779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=6d46631580f04d5b8eb42424d520f83c, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:58.905284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:58.978547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 300/587] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:44:58 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:44:58.978547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.001753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0cc0f-d07e-4f08-94de-1923b77b9560 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.047168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.047860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.048142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.048414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.052331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.060062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.061741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:59.079302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:59.080325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:44:59.081274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:59.090781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 288/588] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:59.092099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.151587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b034a4-3016-4872-b91a-0f380347600d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.193599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.195438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.196223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.196695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.197872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:59.198371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.200860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.218181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54295517-8797-450e-8661-1ed2c2d09156 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.223899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 301/589] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:44:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:59.225012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.268375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.269101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.271761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.271761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.279111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.280554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.290317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:44:59.294759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:59.295864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:44:59.297070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:59.299361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 289/590] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:59.300297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.353649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7be1f-14a5-4fd9-b6f6-1d6993302452 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.398978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.401872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.402429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.402868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.403158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.404217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:59.404545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.406246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.435168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 302/591] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:59.435168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.453588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1405f71-e5d5-4a36-9665-b2a23d287aeb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.489400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.490076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.490357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.490662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.501708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.503209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:59.518051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:59.519071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:59.519950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:59.519950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.519950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:59.519950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 290/592] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:59.520608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.560758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bada14e-064e-4049-8eb6-3771dd2d3d41 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.562609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.597096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.598097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.598602 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.599106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.600031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:59.600530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.602236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.620304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918972b9-e850-47fd-8dc4-f6888b44b04e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.622302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 303/593] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:59.623405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.630848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.655376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.656106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.656480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.656870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.669410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.671246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:59.686647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:59.687850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:59.688988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:59.688988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.688988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:59.690556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 291/594] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:59.691415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.746825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8e57b-5b9f-411a-8a39-dacb00b76e97 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.781630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.782230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.782480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.782786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.783553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:59.783802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.785148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.796877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 304/595] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:59.797910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.807683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331d470-e5a9-4db4-b6ce-52897d5f9f5b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.820793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.848472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.849532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.850548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.851583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.864065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.866002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:44:59.881548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:44:59.882614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:44:59.883521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:44:59.883521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:44:59.883521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:44:59.886010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 292/596] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:44:59.887439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:44:59.908501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c4271-38b8-44c3-b59c-33c1dd9351d2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:44:59.908676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:44:59.944430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:44:59.945047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:44:59.945370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:44:59.945587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:44:59.946229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:44:59.946543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:44:59.947916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:44:59.963974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 305/597] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:44:59.964857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.005169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb301873-30bd-4f39-810a-f073ccb603e0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.043162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.044419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.044899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.045384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.047010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.054751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.056470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.066500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524810-220a-436f-bffe-d26bbd386e44 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:00.074912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:00.075823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 293/598] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:00.076838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.101429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.102044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.102322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.102649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.103266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:00.103568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.104920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.118347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 306/599] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:00.118347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.158970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.192059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275657-3098-41b0-9741-4a4910aea43f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.227317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d99c-9f44-4ead-bf38-d43b22788ca5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.231773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.232686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.233167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.233650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.241367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.243583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:00.255957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:00.256898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.257795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:00.260361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 294/600] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:00.261331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.266838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.271971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.280317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.284054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 307/601] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:00.284843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.372115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe5d2-3f0b-409f-9a41-42fa2ec2274d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.385355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21e1-7a39-4dba-b153-a9d556eba7e1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.409414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.410548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.413866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.414697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.415455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.422021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.422656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.422934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.423213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.423905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:00.428946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.429078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.429173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.429258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:00.440483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:00.441581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:00.442950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:00.443483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 308/602] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:00.444382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.444492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 295/603] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:00.447665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.518635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.563823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4154a6-1231-4fc0-a646-65b0ecc2d35f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.573896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acdf67-000b-4c8f-af8c-190f2d940d81 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.600534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.601720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.601995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.602261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/0fb6edf322d64dad81ac0bca7a1c32c3/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.608049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.608707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.608984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.609253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/971fc696d71f4812bf3e50bafb3871a0/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.618045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=0fb6edf322d64dad81ac0bca7a1c32c3, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.619499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.629193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=971fc696d71f4812bf3e50bafb3871a0, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.630683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc22871-145a-4af9-848f-4e3ffcf1ad80 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.691583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 309/604] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:00 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/0fb6edf322d64dad81ac0bca7a1c32c3/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:00.692331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.728744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 296/605] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:00 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/971fc696d71f4812bf3e50bafb3871a0/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:00.728744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca868-e14d-4925-b756-5b98824d20c0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.728744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca868-e14d-4925-b756-5b98824d20c0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.728744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ca868-e14d-4925-b756-5b98824d20c0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.728744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 297/606] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:00.736029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb5d4-da92-4348-ae6b-e320f3b6f7d2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.736328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb5d4-da92-4348-ae6b-e320f3b6f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.736579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bb5d4-da92-4348-ae6b-e320f3b6f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.783774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-445bb5d4-da92-4348-ae6b-e320f3b6f7d2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:00.785029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-445bb5d4-da92-4348-ae6b-e320f3b6f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:00.837160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373133ce-aa76-488b-a1aa-db29d2529a53 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:00.849975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.878021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:00.878704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:00.878987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:00.879261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:00.879982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:00.880274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:00.881866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:00.895683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 310/607] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:00.902136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:00.912689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:00.957255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 298/608] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:01.067812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae79-66cb-4765-839e-efe429ebdd7b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.068142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae79-66cb-4765-839e-efe429ebdd7b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.068372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae79-66cb-4765-839e-efe429ebdd7b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.069992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 299/609] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:01.071637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae65d9f-cd4d-459a-915a-08021342ea3a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.075331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.075616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.075891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.110727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:01.111924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:01.132862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.133528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.133807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.134409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/4a8a0dbe3ac0405c876c1a07f500bd7f/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.164828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=4a8a0dbe3ac0405c876c1a07f500bd7f, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:01.167641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:01.214220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 300/610] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:01.244247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.275698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 311/611] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:00 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/4a8a0dbe3ac0405c876c1a07f500bd7f/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:45:01.396693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6936a6-2db2-496b-9a49-ae402a5bdf8b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.399048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:01.439485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.440284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.440723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.441107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.456527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:01.462033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:01.463192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:01.464294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:01.470544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 301/612] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:01.473170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.500174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:01.502828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.599207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf6f41-4e89-4a49-8de1-ee6d9f945e0d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.635022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.635628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.635902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.636173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.636826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:01.637123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:01.638538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:01.647008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 312/613] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:01.653008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.686934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33bc60-ea08-44bd-9fbd-b72b4ab645a9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.727090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.727642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.727913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.728177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.739788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:01.745503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:01.746450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:01.747323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 302/614] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:01.759658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.804896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:01.834106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:01.868567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773924f-b54c-4e29-ba10-14bc00eb9a60 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.911944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.912583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.912856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.913221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.924559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:01.926075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:01.935588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f0b76-474f-4fb1-8cae-d7f01d46eb72 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:01.941755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:01.942720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:01.943639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:01.943639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:01.943639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:01.943639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 313/615] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:01.951899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:01.974039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:01.977228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:01.977458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:01.977738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:01.978424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:01.978756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:01.980135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:01.999387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:02.004941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.145390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b772f-ff24-4ebf-8f4d-938672162b3b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.177715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:02.202047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.202872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.203153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.205017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884780e-ff1e-4d82-b381-c206c5f3ee2b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.206665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.207376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:02.207686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.209049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.211591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:02.233751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 314/617] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:02.238387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.272011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12689428-50f5-4036-8ace-756312310d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.272741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12689428-50f5-4036-8ace-756312310d79 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.272902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12689428-50f5-4036-8ace-756312310d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.273168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12689428-50f5-4036-8ace-756312310d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.291808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12689428-50f5-4036-8ace-756312310d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.293273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12689428-50f5-4036-8ace-756312310d79 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-12689428-50f5-4036-8ace-756312310d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:02.317434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:02.318636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:02.319741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:02.319741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:02.319741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:02.319741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 304/618] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:02.325287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12689428-50f5-4036-8ace-756312310d79 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.415088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa33b-3743-47b5-9c93-b1f857f7afb5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.480229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.480939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.481277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.481694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.494931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.497183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.504311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12689428-50f5-4036-8ace-756312310d79 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:02.515758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:02.516825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:02.517800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:02.522869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 315/619] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:02.524871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.611238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.611864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.612143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.612412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.613036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:02.613242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:02.613412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.614743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.621011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:02.638719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 305/620] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:02.645025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.691395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0298-44a4-446b-b644-75c7bffe9f14 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.756274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.756865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.757145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.757416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.758150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:02.758455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.760233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.778727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 316/621] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:02.784148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.825044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1857be-ff9f-4566-923e-9bcc7681eeda None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.877848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:02.878488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:02.878792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:02.879065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:02.892944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:02.894420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:02.916965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:02.917983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:02.918987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:02.921452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 306/622] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:02.926593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:02.964696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b142-b2f6-4f04-ac49-0035712d3020 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:02.979111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.002990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.004080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.006564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.007525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.027574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.029018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.040331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8786eb11-c4a2-4d47-9a30-bf0ec528be2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:03.061290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:03.062558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:03.063708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:03.063708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:03.063708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:03.064906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 317/623] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:03.066087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576933-ff4a-4362-952f-80cd4d1dd28f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.066470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576933-ff4a-4362-952f-80cd4d1dd28f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.066862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576933-ff4a-4362-952f-80cd4d1dd28f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.072690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 318/624] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:03.073758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54576933-ff4a-4362-952f-80cd4d1dd28f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.093860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379ad4-c03a-4ca5-ab6d-a8a4c5aaa7d0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.130131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.130873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.131142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.131410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.132677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:03.132977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.135020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8545dc-293f-4fb8-85ba-b6bce36d4d63 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.159026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 307/625] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:03.159026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.159026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.159026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.174270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:03.175492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:03.184948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54576933-ff4a-4362-952f-80cd4d1dd28f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.220867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.221568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.221952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.222292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.223034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:03.223397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.224946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843fac0-2491-4049-ae11-af32f052f1e7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.236958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 319/626] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:03.238190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b566-20c8-4b1d-be59-80fb9aa14768 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.238548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b566-20c8-4b1d-be59-80fb9aa14768 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.238871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2b566-20c8-4b1d-be59-80fb9aa14768 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.240259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 320/627] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:03.240840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b566-20c8-4b1d-be59-80fb9aa14768 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.250260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 308/628] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:03.259747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.269178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.320041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.356455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2b566-20c8-4b1d-be59-80fb9aa14768 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.393446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45f9e-c1f9-4a1c-b60e-2894522fa39d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.394964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.395776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.396148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.397806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.439265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.440134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.440558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.440974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.451120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.452770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6297a4cb-d372-4404-8ac1-f9f313fb3538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:03.469350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:03.470445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:03.471538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:03.474010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 309/629] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:03.475477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.476384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.476800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.488155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.489741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.498731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:03.500493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:03.515933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.572668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 310/630] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:03.573493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.593948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 321/631] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:03.595013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.611272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.676929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d8a41-426b-453e-93e4-8981db196062 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.708464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4aa7f-0f29-460f-84eb-332cd8dde3c0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.713533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310022b-8d64-405e-9730-860528a01235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.714352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310022b-8d64-405e-9730-860528a01235 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.714846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310022b-8d64-405e-9730-860528a01235 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.715318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310022b-8d64-405e-9730-860528a01235 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.716583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310022b-8d64-405e-9730-860528a01235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:03.717070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310022b-8d64-405e-9730-860528a01235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.719378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310022b-8d64-405e-9730-860528a01235 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.732056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 311/632] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:03.733441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6ecd-d38e-460b-bef5-3a0b06b03f48 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.733727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6ecd-d38e-460b-bef5-3a0b06b03f48 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.734004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6ecd-d38e-460b-bef5-3a0b06b03f48 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.739392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 312/633] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:03.739392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6ecd-d38e-460b-bef5-3a0b06b03f48 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.739580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.750678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.751323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.751599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.751871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.762591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:03.767763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:03.768671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:03.769525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 322/634] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:03.770228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:03.839614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:03.847445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6ecd-d38e-460b-bef5-3a0b06b03f48 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.879867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345baeec-2643-4706-ab34-26f9cd3c6e08 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:03.884778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.885403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.885681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.885949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.896902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.898443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.912712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:03.913881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.914156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.914426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/fae4b6d2e7f5478495814d5f392b2b27/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-59f92e71-45ab-46b4-a560-0876c4ee8847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:03.915909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:03.916901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:03.917782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:03.917782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:03.917782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:03.917961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 313/635] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:03.919152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:03.919438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:03.919708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:03.929787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=fae4b6d2e7f5478495814d5f392b2b27, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:03.931255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:03.942411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:03.943622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:04.006818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 314/636] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:04.007611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.044148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 323/637] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:03 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/fae4b6d2e7f5478495814d5f392b2b27/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:04.045544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.094755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.110650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.129436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711836b-62b6-4f2c-b4a1-c46eccae71a9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.166553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.167485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.167907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.168315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.169133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:04.169582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.171891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.185858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 315/638] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:04.187156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.205622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287f7e-f491-4ecb-b748-698b0c05ec02 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.253145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.254044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.254320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.255066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.274632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:04.279336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:04.280292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:04.281160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 324/639] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:04.281875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.328044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c7c4-951a-45e4-8bab-2ea61d9b1713 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.373694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.374300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.374609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.374940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.375570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:04.375872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.377541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.386217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.388765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.393070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0ce92-3220-4c28-ab7c-25f439f0143c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.395972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 316/640] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:04.396616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.435993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.436968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.437445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.437938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.450043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.453548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:04.468516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:04.469519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:04.470423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:04.470423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:04.470423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:04.470423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 325/641] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:04.470423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.512126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af6bf-18a5-439a-a214-d73efa061d08 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.550206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.550900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.551180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.551448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.552159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:04.552465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.553865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.562106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 317/642] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:04.563008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.586584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940747d-5ef0-429d-9fd4-f5959d204543 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.620709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.621615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.622090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.622549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.624890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.634308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:04.671751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb49ff-2a64-483c-858c-2308abf2b06c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.709834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.710489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.710788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.711064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.721130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.725201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:04.738115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:04.739393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:04.740341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 318/643] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:04.740857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:04.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:04.772023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 326/644] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:04.773513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.783588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.878859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f475-8dad-4f44-bb09-7a1159e582a3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.885191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9a946-1ebb-414d-a767-ef9c1928bcef None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:04.912073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:04.930305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.932506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.932506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.932506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.933057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:04.933630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:04.933912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:04.934181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:04.936069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:04.936069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.937064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.946615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:04.948105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:04.950506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 319/645] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:04.951515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:04.969670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:04.970708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:04.971622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:04.971622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:04.971622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:04.971622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 327/646] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:04.971622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.037634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.072361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553517-f93a-40d9-84a6-006f7e599e87 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.095284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884c27-c488-43fc-b85d-179253633e4b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.112237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.112860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.113128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.113398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.114099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.114403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.115857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.128027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 320/647] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.128835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.137121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.137677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.137957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.138230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.138923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.139230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.140665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.153766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 328/648] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.153766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.178235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.253400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f552-721e-42ff-a6a7-a7950c270752 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.273618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f055c6-c297-4e02-8256-7818406c02ca None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.290382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.291192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.291503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.291751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.297056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.299713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.301144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:05.312154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:05.313221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 11:45:05.314394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:05.315720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.316428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.316707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.316973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.317859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.318016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 321/649] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:05.318151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.318752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.320095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.333898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 329/650] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.334724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.429738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.432558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c16cd-8273-41dc-b283-17aca2fa5271 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.453628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5b45c-d0ab-4f2a-9d76-9944647e9373 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.472441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.473462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.473735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.474149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.474900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.475200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.477130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.483228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 322/651] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.488384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.489144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.489489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.489829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.495962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.505456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.507010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:05.523919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:05.524929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:05.526432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:05.526432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:05.526432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:05.526432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 330/652] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:05.526432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.563165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.640284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31569d-071b-4ffe-ac20-4c2b934741cf None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.649322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbd419-e636-4220-856e-565ba3a55292 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.687225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.688064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.688347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.688632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.689347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.689651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.691175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.693263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.694866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.695333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.695779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.704778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.706465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.712166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 323/653] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.713020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:05.720771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:05.722027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:45:05.723212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:05.725336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 331/654] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:05.731030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:05.741414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.846494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46a50-2464-4a0f-b30f-2a2d1ffb2244 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.847684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:05.857229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8474ff8-0a79-4fda-bdd3-33b6867479b6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:05.893785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.894393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.894721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.894994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.895497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:05.896292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:05.896740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:05.897277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:05.898374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:05.899361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:05.900301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:05.915990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 324/655] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:05.917538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.003025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.004509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa18280-faf5-46ca-bcb1-c1004cdbc9ed None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.034233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.054080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c034-8c2a-454e-85f1-008d01c159d2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.091791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.092870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.093149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.093417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.094153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:06.094455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.095919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.114280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 325/656] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:06.115116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.127423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.137610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 332/657] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:06.138820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576601-7959-4370-a996-a7d810cf8a8b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.139104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576601-7959-4370-a996-a7d810cf8a8b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.141738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576601-7959-4370-a996-a7d810cf8a8b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.141738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 333/658] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:06.141738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71576601-7959-4370-a996-a7d810cf8a8b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.223378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85bfd-63af-459b-9603-64c9eb50a4f7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.247983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71576601-7959-4370-a996-a7d810cf8a8b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.263363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.263930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.264207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.264475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.271709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.273710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.276919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:06.287329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:06.288412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 326/659] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:06.289445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.295858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.296466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.296743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.297009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.357239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.366423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.367874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878315b3-9606-4703-ae4c-034f65c50181 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.412529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e768e-c9ba-4af8-a8c2-4c1549a5e6fc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.449506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.450138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.450438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.453715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.465753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.467248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.476259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 334/660] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:06.477514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.477801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.478074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:06.485994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:06.487019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:06.493113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:06.493113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:06.493113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:06.493113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 327/661] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:06.493113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.499032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:06.500225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:06.545235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.574853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 335/662] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:06.574853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.601792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74011d63-dc86-4ff1-882b-799e11d8b5b2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.610978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.643492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.644255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.644547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.644823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.645716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:06.646008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.648096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.672280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 328/663] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:06.673167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.708621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669d8a5-c973-4851-9b1b-da5b2aba2fcd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.757179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.758138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.758675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.759376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.773265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.775429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.787596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced4c2-72e6-44ab-9ca9-34532c25ccec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:06.796117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:06.797137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:06.798053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:06.798053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:06.798053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:06.800204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 336/664] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:06.801686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.802544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.833728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.834475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.835001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.835714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.836466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:06.836897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.838555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:06.852559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 329/665] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:06.853504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:06.892993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:06.917812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6b312-a93a-4447-8df2-cc7043a45c26 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.956997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.957607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.957884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.958158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.959430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ea845-e075-4362-8a1e-238d5e7c5384 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:06.995060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:06.996011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:06.996284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:06.996549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:06.997213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:06.997512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:06.998928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.011280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 330/666] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.011905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.035020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.036468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.049778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.115075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.123818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef5485-4dcb-4486-91a2-8c7818e5333b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.141857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 337/667] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:07.142775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.163965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.164591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.164866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.165146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.175093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:07.180230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:07.181168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:07.182019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:07.186145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 331/668] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:07.186995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.247081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968608b4-1637-4ed7-8e05-fe7deba3b508 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.284927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.285131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.285917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.286166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.286437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.293714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.295177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.296788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e1e2e-b9dd-497d-8e24-90d57072f5ab None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:07.308572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:07.309674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 338/669] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:07.310589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.344006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.344637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.344917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.345191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.351167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.352490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.353933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:07.365179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:07.367074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 332/670] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:07.368246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.429224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836408b1-8371-4f92-8026-f2c78e5d5f0b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.471668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.472415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.472782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.473148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.477791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f45ed5-a17a-47a4-9de8-dd7fabf08dab None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.484094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.485581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:07.499959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:07.501144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:07.502327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:07.502327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:07.502327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:07.508290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 339/671] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:07.509189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.518584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.519295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.519965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.519965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.520675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.521017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.523291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.532530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 333/672] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.533233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.548811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.601593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.616095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be68ef-60d9-467d-8fad-686ebe298323 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.633724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc35a-a8e5-4070-90d4-167f4f7f3022 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.650982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.651587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.651867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.652137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.652820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.653123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.654549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.665576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 340/673] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.666350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.671914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.672518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.672795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.673065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.673762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.674066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.675500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.686917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 334/674] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.687692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.753829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.763206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd153d-343f-43e9-8402-09f9b25cb254 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.784548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4ee01-5f6f-4ebd-8da5-8450931c3b53 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.795921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.796520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.796791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.797061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.797688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.797982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.799349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223be5-e950-4ab8-bf36-86961db0f01c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.811323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 341/675] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.812555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c10b-f044-45ab-9007-17da84d8a235 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.812840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c10b-f044-45ab-9007-17da84d8a235 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.813108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c10b-f044-45ab-9007-17da84d8a235 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.814450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 342/676] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:07.818511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.818685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28c10b-f044-45ab-9007-17da84d8a235 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.819714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.819990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.820262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.827856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.830796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.832227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:07.846238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:07.847198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:07.848097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:07.848097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:07.848097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:07.848097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 335/677] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:07.848097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.924493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28c10b-f044-45ab-9007-17da84d8a235 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.947894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e9caa-0d22-4681-9878-1e2ef39e4e11 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:07.961660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.962623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.962901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.963171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.963890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=0fb6edf322d64dad81ac0bca7a1c32c3) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.964194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.965616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:07.971360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:07.971481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 343/678] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/role_assignments?user.id=0fb6edf322d64dad81ac0bca7a1c32c3&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:07.972554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:07.992301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:07.992929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:07.993211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:07.993484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:07.994263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=971fc696d71f4812bf3e50bafb3871a0) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:07.994656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:07.996485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8af099-bbc8-448e-9f93-c3c5a92809bb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.015176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 336/679] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/role_assignments?user.id=971fc696d71f4812bf3e50bafb3871a0&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:08.016654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4686-232a-4581-8687-8575252f39db None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.017344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4686-232a-4581-8687-8575252f39db None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.018128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b4686-232a-4581-8687-8575252f39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.038990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-522b4686-232a-4581-8687-8575252f39db None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:08.040658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-522b4686-232a-4581-8687-8575252f39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:08.069410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.108197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188f85-851b-4c1a-a938-a318b864a24b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.134558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 337/680] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:08.134558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4686-232a-4581-8687-8575252f39db None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.164402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.165340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.165622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.165898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.176225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.181398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:08.199128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:08.200285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:08.201442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 344/681] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:08.206838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.278223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b4686-232a-4581-8687-8575252f39db None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.297809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.324049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.324674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.324956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.325232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.325883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:08.326183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.327595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.346650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 338/682] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:08.348501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.361863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45403e8d-2dbd-4314-afd4-eeea27f7b527 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.395357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.401984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.402634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.402919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.403194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.403893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:08.404234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.405656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.424865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 345/683] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:08.426168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.476667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7908a-361c-42cc-aa34-cdfc81b2221f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.522346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.523021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.523302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.523576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.534349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.535831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.549109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d09471-7567-4c79-b4b8-6a80167d2b17 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:08.552285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:08.553827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:08.554877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 339/684] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:08.555524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.594369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.595033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.595310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.595585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.596319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=4a8a0dbe3ac0405c876c1a07f500bd7f) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:08.596627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.598307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.604430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.610658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 346/685] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/role_assignments?user.id=4a8a0dbe3ac0405c876c1a07f500bd7f&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:08.611678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.677841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8114e-d4c4-46f0-85e2-abca1be604b5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.721015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.722061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.722341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.722782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.736023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:08.741689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:08.744302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:08.746288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:08.761893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.762056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 340/686] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:08.762056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.829024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46627b28-be9d-4e50-a186-5342d854e132 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.869416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.870032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.870311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.870617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.871349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:08.871711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.873066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.880964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:08.884096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc49b51-d8ce-4e3b-bf3f-12df98ffb4cb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:08.895166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 347/687] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:08.906503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:08.929880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:08.930848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:08.931330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:08.931816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:08.933188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:08.933838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:08.935710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:08.946732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 341/688] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:08.951592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.034185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e859907-b919-46ba-8ad7-6f034a50f361 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.050840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.080158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.080724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.081004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.081329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.084856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f59147-bf9b-4417-9f33-05248d84dab1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.128561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.129542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.130038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.130711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.146078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.151094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:09.172361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:09.173413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:09.174318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:09.174318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:09.174318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:09.175053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 342/689] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:09.180524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.196931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.198372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.213480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.335292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e2c3-6cbe-4cdf-8596-8918776f4906 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.372892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.373874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.374357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.374876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.375843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:09.376466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.378042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.392474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 343/690] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:09.400294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 348/691] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:09.401523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.407509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.444440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.511561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.574852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c768-860f-4a3f-a67c-4ea930a7f7bc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.585050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71743689-f045-4bf6-936c-746e57e19bf6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.613360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.614368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.614904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.615542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.626306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.628157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:09.644250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:09.645241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:09.646208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:09.646208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:09.646208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:09.649461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 349/692] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:09.657172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.679237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.679893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.680178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.680456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.688098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.689536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:09.722861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:09.723901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:09.725557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 344/693] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:09.729708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.729960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.770955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f292-4110-4cb6-8dd8-451eff6bcc04 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.809164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.810148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.810783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.811140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.811860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:09.812234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.813874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.836306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 350/694] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:09.836306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:09.917896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3f03-19a9-4753-bf7a-eb4564744140 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:09.950385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:09.956005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:09.956615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:09.956896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:09.957170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:09.957973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:09.958279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:09.960451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:09.979691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 345/695] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:09.987508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.001382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6645e-3138-4223-b6db-8a3aa893ec86 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.026376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.037980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.039721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.046776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.046776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.052451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.054682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:10.066345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:10.067284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:10.068191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:10.071293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 351/696] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:10.077219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.203243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a30b1-3cfa-4f43-b807-536f46109841 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.230408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11157e-fee1-4689-a735-9863781ed15f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.238345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.239006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.239539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.239539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.268438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.272424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.272424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.272424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.272424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:10.272424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.273060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825c30e-9227-4548-a721-958c1a8cb662 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.287793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 352/697] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:10.289347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d7e3-ec08-41b9-b075-a71d2428c56d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.289945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d7e3-ec08-41b9-b075-a71d2428c56d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.290416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2d7e3-ec08-41b9-b075-a71d2428c56d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.292190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 353/698] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:10.293382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2d7e3-ec08-41b9-b075-a71d2428c56d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.306414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.317603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.319575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5569-ebc1-4cd3-b13a-c71232f21770 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.347860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.411562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2d7e3-ec08-41b9-b075-a71d2428c56d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.425477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 346/699] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:10.426837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7956d-12a6-4c2d-9699-a6998c29b84a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.427125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7956d-12a6-4c2d-9699-a6998c29b84a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.427399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7956d-12a6-4c2d-9699-a6998c29b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.445562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-50f7956d-12a6-4c2d-9699-a6998c29b84a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:10.446767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-50f7956d-12a6-4c2d-9699-a6998c29b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:10.450809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.451631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.452081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.452544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.453497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=fae4b6d2e7f5478495814d5f392b2b27) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:10.453989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.455713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.462762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 354/700] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/role_assignments?user.id=fae4b6d2e7f5478495814d5f392b2b27&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:10.464031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.540084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 347/701] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:10.542188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737384-ef5c-4f23-b4bc-9871f3d87889 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.542188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737384-ef5c-4f23-b4bc-9871f3d87889 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.542663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737384-ef5c-4f23-b4bc-9871f3d87889 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.544467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 348/702] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:10.549915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.550341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.550739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.580675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4305355-5a63-4072-a31d-d054eb49b7e3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.587719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:10.589524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:10.591779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.616729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.620294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.621209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.621688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.622159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.633250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.635274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:10.650221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:10.651249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:10.652281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:10.652281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:10.652281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:10.654315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 355/703] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:10.659693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.675048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 349/704] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:10.773307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f10bde-a608-4dda-baf3-b061b387d32a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.808254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.809245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.809717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.810228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:10.811087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:10.811579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:10.813151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:10.825909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 356/705] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:10.830949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.864255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:10.887729 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:10.956666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03081f-c637-4a72-8610-ae243d5e4162 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.984779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8e7b-5280-4438-b25c-e33dc7202bd3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:10.998216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:10.998964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:10.999351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:10.999706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.011336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.012814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:11.025899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:11.026852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:11.027778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 350/706] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:11.028268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.033642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.034492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.034809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.035062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.035652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.037005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.044128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:11.055246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:11.056327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:11.057235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 357/707] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Aug 12 11:45:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:11.058070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.138219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca29d46-6a3d-44fb-acc4-4f9ead2ba41d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.151882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.169122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a28037-c468-4c3c-8a13-6496d7863ba3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.173854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.174610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.174950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.175290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.185990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.187590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:11.205972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:11.207706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:11.208634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:11.208634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:11.208634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:11.208816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.208915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 351/708] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:11.208987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.208987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.209124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.209258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.211102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:11.211411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.212896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.227158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 358/709] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:11.227942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.290457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.331381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49747a4-8d0a-42b4-88f4-d80264a87a9f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.331911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161ada-1797-4c25-86c5-956b71c20443 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.367143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.367748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.368022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.368287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.368927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:11.369224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.370575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29f1c0-fd44-4822-a2a7-300318489797 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.372194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.373003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.373283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.373552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.374244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:11.374574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.375917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.389714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 359/710] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:11.389714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d144-6f10-4e77-9b9b-fb545404dec3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.389714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d144-6f10-4e77-9b9b-fb545404dec3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.389714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d144-6f10-4e77-9b9b-fb545404dec3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.390189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 352/711] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:11.390285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 360/712] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:11.390370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.390453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d144-6f10-4e77-9b9b-fb545404dec3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.397287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.499796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51414c66-9e7e-482f-9bb1-214762c1488d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.508229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d144-6f10-4e77-9b9b-fb545404dec3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.528726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.539708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.540625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.540856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.541124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.541844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:11.542151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.543669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.544517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.545124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.545403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.545672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.546404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:11.546726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.548071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895717-b19b-45e2-9ff4-7bb5d122c291 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:11.550576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 353/713] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:11.551923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:11.562556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 361/714] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:11.562556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.562556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.562556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.591355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:11.594278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:11.719979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:11.736332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 362/715] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:11.873065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8c89d-00e8-4585-9346-4f1cb6878aa6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:11.908541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:11.909160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:11.909441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:11.909713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:11.910362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:11.911813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:12.014797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:12.020860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 354/716] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:45:11 2022] POST /identity/v3/users => generated 254 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:12.153028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e65b0c-93d9-4c9c-96bb-6f1a80780e56 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:12.199111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:12.200645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:12.200645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:12.200645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:12.200916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:12.202234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:12.223653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:12.225266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:12.226114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 363/717] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:12 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:12.231937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:12.294861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:12.362314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e491f1-6356-421d-a83d-f08e3a6adfac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:12.405102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:12.405653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:12.405933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:12.406205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:12.406879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] RBAC: Adding query filter params (name=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:12.407178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:12.408548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce36aa-8d2e-4711-bcc7-a5d898adb352 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:12.414968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 355/718] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:12.419145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:12.502132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:12.543337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9646cc7-bcdc-42f6-b94d-2fc94edd7be6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:12.582994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:12.583612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:12.583889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:12.584710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:12.585351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] RBAC: Adding query filter params (type=network) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:12.585652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:12.587038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec8eb3-718e-46c7-9d17-a85a6ddd384c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:12.592079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 364/719] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:12.913693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47a37-d802-4729-9d35-e7183d30f226 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:12.913986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47a37-d802-4729-9d35-e7183d30f226 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:12.914258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f47a37-d802-4729-9d35-e7183d30f226 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:12.915898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 356/720] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:12.924335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:12.924867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:12.925341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:12.944965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:12.946465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:13.029770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 365/721] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:13.352774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47a37-d802-4729-9d35-e7183d30f226 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:13.480150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f47a37-d802-4729-9d35-e7183d30f226 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:13.491854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:13.526016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:13.526688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.526967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.527236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.543553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-53f0ee90-b61d-4747-921d-1464aff7efac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:13.548234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:13.549156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:13.549999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 357/722] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:13.558911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:13.670968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:13.735353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d372f3-f356-4dab-bc29-934b63b69bfd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:13.784511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:13.785123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.785403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.785682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.786344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:13.786671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:13.788585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:13.797007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 366/723] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:13.801304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353edce-6cfe-43e0-bc61-038621284e9a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.801782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353edce-6cfe-43e0-bc61-038621284e9a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.802064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353edce-6cfe-43e0-bc61-038621284e9a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.803491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:13.803719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 358/724] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:13.808744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3895-94ae-4e99-9423-bd4523554b8e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.809027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3895-94ae-4e99-9423-bd4523554b8e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.809299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b3895-94ae-4e99-9423-bd4523554b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.852110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d05b3895-94ae-4e99-9423-bd4523554b8e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:13.853298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d05b3895-94ae-4e99-9423-bd4523554b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:13.922906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695128d-e9e4-40b7-8abe-8590cd9e7352 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:13.926898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 359/725] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:13.928196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69071-b34a-4153-8a1d-0e8a8d0cb2b9 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.928484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69071-b34a-4153-8a1d-0e8a8d0cb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.928757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69071-b34a-4153-8a1d-0e8a8d0cb2b9 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.938919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 360/726] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:13.944886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:13.945031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.945291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.945571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.971807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:13.972442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:13.972720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:13.972989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:13.990134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:13.994498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:13.995747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:13.998731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:14.024148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:14.025133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:14.026784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:14.026784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:14.026784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:14.026784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 367/727] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:14.030762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.133487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4f058-62c9-40fb-b557-83486233044b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.154491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 361/728] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 11:45:14.180630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.181169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.181447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.181718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.182362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:14.182690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.184090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.205017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 368/729] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:14.212707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.249212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.258291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.295925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.369508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe6e3-116c-403f-bf65-b15b681d2bfa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.378493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d0934-f13c-4dc7-926b-299144ac440e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.405118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.406432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.406432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.406432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.416603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:14.421644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:14.422641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:14.424120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 369/730] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:14.431989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.444271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.445226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.445713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.446181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.454873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.457157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:14.471945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:14.472887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:14.473874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:14.477105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 362/731] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:14.482030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.559664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.571300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db618-c1ad-40b5-bcf2-d5ea9823260b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.613140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.614141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.614649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.615665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.616558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:14.617060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.620548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.630254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 370/732] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:14.631956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.646012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d1b0-559a-4768-b609-1f667990ccb0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.678946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.680691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.681407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.681808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.682232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.683073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:14.683477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.685016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.703593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 363/733] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:14.704901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.742656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5baa-a0c1-424f-a6f9-00771612cfba None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.778987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.779601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.779881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.780155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.780802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.782167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.824610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48258-501c-45bf-ae71-f975293ee17e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:14.859650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:14.860282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.860563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.860835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.871995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:14.873421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:14.874146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 371/734] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:14 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:14.875183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:14.892633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.901058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-530c6498-4e2b-4f7c-b198-c2e72966de14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:14.902477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:14.903470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:14.904429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:14.904429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:14.904429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:14.911164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 364/735] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:14.913590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceda74-009e-4c8d-b73b-3e53a516df0b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:14.914104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceda74-009e-4c8d-b73b-3e53a516df0b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:14.914381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceda74-009e-4c8d-b73b-3e53a516df0b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:14.918901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 365/736] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:14.918901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceda74-009e-4c8d-b73b-3e53a516df0b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.035302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d536e8-1b62-443a-bc4e-e7f8c52c6fab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.039676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceda74-009e-4c8d-b73b-3e53a516df0b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.078185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.079073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.079433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.079686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.079963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.080235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.080445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.080884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.081724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:15.082201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.084888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9883-618a-4cbc-b562-fb8907ff508e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.100944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 366/737] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:15.102433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503846-5faa-4e87-809a-447230bcecbc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.102897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503846-5faa-4e87-809a-447230bcecbc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.103310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48503846-5faa-4e87-809a-447230bcecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.123329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-48503846-5faa-4e87-809a-447230bcecbc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:15.123774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-48503846-5faa-4e87-809a-447230bcecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:15.173331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.175309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08937d25-8091-4156-aa46-9bc3acfeaff5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.188551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.190437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.201594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 367/738] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:15.204833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503846-5faa-4e87-809a-447230bcecbc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.312422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 372/739] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 11:45:15.314201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2cd3-7b79-44ff-987d-1bc7aa8185ff None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.314721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2cd3-7b79-44ff-987d-1bc7aa8185ff None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.315109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2cd3-7b79-44ff-987d-1bc7aa8185ff None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.315644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48503846-5faa-4e87-809a-447230bcecbc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.320403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 373/740] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:15.320403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2cd3-7b79-44ff-987d-1bc7aa8185ff None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.362328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.363297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.363787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.364294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.373987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.376440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-86a230d6-dc1d-4332-b773-ae3f8a6ddd36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:15.392681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:15.394310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:15.395351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:15.397001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 368/741] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:15.399367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.400130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.400705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.424532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:15.426610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:15.440759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2cd3-7b79-44ff-987d-1bc7aa8185ff None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.452825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.484750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.485355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.485638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.485913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.495439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.496584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.498334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.522575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 369/742] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 11:45:15.522575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:15.522852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:15.523746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:15.524662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:15.524662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:15.524662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:15.524662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 374/743] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:15.524662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.624384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f0ffc-07e3-4d54-892a-e257eef3a717 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.628020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc142-61d8-4915-9199-0d08db90e5bc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.660982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.661955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.662439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.662957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.663946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:15.664467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.666079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.667923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.668546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.668818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.669084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.679626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:15.684988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:15.686233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:15.687133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:15.688412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 370/744] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:15.689630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.690602 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 375/745] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:15.691387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.720057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.731945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.795208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ad615-2914-4d3c-bd9e-6a261c6e7351 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.803826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eda10-c9e6-4b08-ac1e-b0387ec1f8f5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.830886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.831490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.831761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.832035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.832653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:15.832947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.834947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.841701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.842337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.842656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.842928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.846493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 371/746] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:15.851208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.855335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:15.856825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:15.871223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:15.872367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:15.873750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:15.873750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:15.873750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:15.876980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 376/747] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:15.877725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:15.951736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.957634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:15.962004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75442c56-de2e-4d75-86c0-8889a0ff50bc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.980965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c29f-42b7-4f7b-8839-5fa7d33c5d1d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:15.996562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:15.997166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:15.997432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:15.997699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:15.998364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:15.998701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.000049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.008913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 372/748] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:16.011797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.023179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.023792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.024411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.024519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.025094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.029090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.105139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 377/749] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:15 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:16.106103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.133054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ec18-2f47-403e-867c-eb206d1c74ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.190784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.192725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.193020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.193853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.204282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.206016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.226535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510db999-e06e-4777-9c0b-6a36396f97aa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:16.227064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:16.227935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 373/750] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:16.234280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.262555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.272138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.277599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.279389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.279389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.279578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.280105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:16.280639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.283130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.295803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 378/751] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:16.296526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.389246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41c705-f810-432f-a3a1-7d602f788bb0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.412703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b5e1-bd3b-4b09-85de-29d91b8fa0e8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.434203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.435534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.436452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.436933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.449567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.451572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.454843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.455715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.456201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.457106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.457988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:16.458477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.460119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:16.469498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:16.470443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:16.471374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:16.471374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:16.471374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:16.471374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 374/752] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:16.471606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.481875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 379/753] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:16.487470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.545714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.565543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.596579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b309b6-e3d3-404d-ac41-464f0b8eac4b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.608045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd5a7b-16a4-4d25-a564-1ece43a6bc7c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.635597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.636241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.636614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.636850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.637503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:16.637810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.639607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.649117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.650036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.650506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.650981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.652955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:16.654166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.658881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.660567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:16.673499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:16.674442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:16.675360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:16.678256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 375/755] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:16.679339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.770246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d068a-c6dd-4bfe-94a8-b96bdd1262a7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.780099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1ffe8-ea78-4ad0-9c32-cfe3bdb3eef9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.785268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.807754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:16.810272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.811112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.811555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.811989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.812920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=fae4b6d2e7f5478495814d5f392b2b27) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:16.813377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.816331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:16.816615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.817143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:16.817509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:16.817882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:16.823233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 381/756] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/role_assignments?user.id=fae4b6d2e7f5478495814d5f392b2b27&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:16.825512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.832174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:16.840402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:16.868473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:16.869507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:16.870465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:16.872554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 376/757] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:16.878542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:16.971350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691e0be-dbe9-4d13-bac9-142baf4db48e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:16.994031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100440a-fc4f-416a-8218-4702bc8299f2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.010762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.011997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.012430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.012858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.013696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:17.014689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.016663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa480104-f731-47a4-977f-53500f596e27 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.029225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.030115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.030115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.030362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.031127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:17.031433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.032842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d36afe-32d0-4fca-80ba-0441db67c80e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.038776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 382/758] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:17.039922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821726-35bf-40df-9767-729fd8fdf6af None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.040433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821726-35bf-40df-9767-729fd8fdf6af None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.040551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36821726-35bf-40df-9767-729fd8fdf6af None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.041814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 383/759] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:17.042354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36821726-35bf-40df-9767-729fd8fdf6af None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.067455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 377/760] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:17.069256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.070303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.070809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.085894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:17.096698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:17.100136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:17.151069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:17.173686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36821726-35bf-40df-9767-729fd8fdf6af None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.175724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 378/761] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:17.176661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.224687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.226294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.226761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.227185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.230192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=6d46631580f04d5b8eb42424d520f83c, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.231880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.294908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6099db-761e-4da4-808e-2bc7fa6c316f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.325664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 384/762] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:17 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:17.333453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.334769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.335049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.335317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.414284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:17.451488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.453985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.525971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.578759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 379/763] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:17.583850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.650718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:17.658298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62dbc-f78a-4e0c-b825-a99d1a30e83f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.674803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:17.696413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.697406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.697899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.698393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.699207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.699622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aed9e-ae4e-46dd-b427-756bc0a18eb2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.701052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:17.717740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:17.730131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:17.731096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 385/764] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:17.731907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.749013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.749818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.750099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.750370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.771424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.772869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:17.799827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:17.800829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:17.802168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:17.802168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:17.802168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:17.802168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 380/765] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:17.808066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:17.897084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd824-ab4d-4364-aadb-36e31cdb1f42 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.975467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:17.976130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:17.976413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:17.976684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:17.977320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:17.977621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:17.979020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:17.984961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b9d64-3e80-41c3-be8b-72fcc429f944 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:17.991168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 386/766] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:17.996680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.036269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.036921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.037202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.037473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.038127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:18.038429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.039839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.053770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 381/767] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:18.054462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:18.054764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:18.059316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.160264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571f63-eee4-478f-b845-cfca665951ac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.196751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.197380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.197654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.197922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.204922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.206341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:18.218616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:18.219505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:18.220842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:18.227510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.276672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a959-c0f2-4894-9f4a-3e2196c0f70e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.292665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:18.326794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.327903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.328436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.328906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.329768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:18.330291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.332006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79bc4-f38a-44f7-b1bf-65894a8556f1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.337821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 387/769] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:18.339350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e339-0325-4e34-ad39-d1df86e23085 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.339839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e339-0325-4e34-ad39-d1df86e23085 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.340331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e339-0325-4e34-ad39-d1df86e23085 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.345902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 388/770] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:18.347002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e339-0325-4e34-ad39-d1df86e23085 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.353691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15be684-d9b9-4838-8455-7536223f9e5e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.404222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.404938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.405258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.405530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.406220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:18.406561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.408667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2dae-5dc9-48bd-ab2e-ea60ae99866e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.426739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 383/771] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:18.428778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.429284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.429755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.453668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:18.455296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:18.456966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:18.473650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e339-0325-4e34-ad39-d1df86e23085 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.512969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.513744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.514120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.514490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.515322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] RBAC: Adding query filter params (interface=public, service_id=df8cd1d3449f44988309a6a68cdbac22, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:18.515731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.517466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.529665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 389/772] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/endpoints?service_id=df8cd1d3449f44988309a6a68cdbac22&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:18.529665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.551092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 384/773] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:18.552996 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.593549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:18.656403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393765-c9bb-423c-aa8d-8be55afee187 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.692251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.692852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e52f1-0087-435b-9941-ed91dce8122b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:18.693783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.694279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.694791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.695583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.697134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.703152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 385/774] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:18.773553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:18.774541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.775018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.775482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.776403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=21f021f13320436c95800de92d844fd7) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:18.776957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:18.778599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252455b4-8694-4f34-bd0c-fe2988023709 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:18.791837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 390/775] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/role_assignments?user.id=21f021f13320436c95800de92d844fd7&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:18.948373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:18.969360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c913706-e687-4bd2-b1c1-1c9980867548 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.969360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c913706-e687-4bd2-b1c1-1c9980867548 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.969649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c913706-e687-4bd2-b1c1-1c9980867548 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:18.971224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 391/776] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:18.983235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:18.983547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:18.983795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.008135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:19.009618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:19.023216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:19.078454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ee2f5-9230-461c-8a39-8c0052920109 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.080152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:19.101517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 392/777] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:19.164618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.165270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.165548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.165820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] PATH_INFO: `/v3/services/network` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.166413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:19.167809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:19.184616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:19.185657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:19.186508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:19.190820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 386/778] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:18 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:19.191776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.338359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56418ef5-6537-4063-9d79-d7859d769536 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.385219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.386233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.386737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.387204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.388035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] RBAC: Adding query filter params (name=network) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:19.388527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:19.390074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:19.404423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 393/779] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:19.410142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.455157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.478563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:19.611954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a1ed3-4932-4f96-b9b1-133adcee912d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.614377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967088-535f-4ad4-bf18-cfdfde2cc3bf None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.652375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.653004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.653698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.653991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.664929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:19.670982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:19.672235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:19.673159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 394/780] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:19.678081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.699294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.699917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.700199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.700468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.701111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:19.701433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:19.702900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:19.720607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 387/781] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:19.727074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.760411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:19.793068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:19.794419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3d958-791a-445e-8837-60b0bca2725c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.838182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.838841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.839117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.839385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.840047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:19.840344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:19.841687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fc0fd-1403-4e6b-9b2e-5b19c00c9438 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:19.852495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 395/782] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:19.859012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f9a4-e5f4-4c57-8aeb-83721b824ae2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.859296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f9a4-e5f4-4c57-8aeb-83721b824ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.859566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f9a4-e5f4-4c57-8aeb-83721b824ae2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.865557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 396/783] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:19.865557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f9a4-e5f4-4c57-8aeb-83721b824ae2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:19.875029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed98c-1069-48a2-b6c7-3299cce4b1c4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:19.910855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:19.911865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.912346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.912818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.913739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] RBAC: Adding query filter params (interface=public, service_id=30911c85e2804d3d8be0d3b9e7f8873e, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:19.914258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:19.915912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ddac-ea4d-49d0-8700-50519affbd84 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:19.928928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 388/784] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/endpoints?service_id=30911c85e2804d3d8be0d3b9e7f8873e&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:19.930631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:19.931156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:19.931641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:19.949923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:19.951458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:19.982298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f9a4-e5f4-4c57-8aeb-83721b824ae2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.023605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:20.024082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 389/785] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:20.030909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.034847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.035486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.035757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.036082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.055084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.056558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.072735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:20.094615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:20.098697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:20.100445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:20.100445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:20.100445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:20.100445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 397/786] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:20.105296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.219904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0b5ee-33d5-4348-8bf6-4092c639fa4f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.279917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d3208-7871-4116-ad55-e6de1373a5c7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.284341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.284951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.285229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.285499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.286107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.288089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.299970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 390/787] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/services => generated 772 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:20.343567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.344187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.344466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.344733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.345390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:20.345691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.347086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.364024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 398/788] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:20.370318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.495448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.543049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:20.562689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:20.572326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5367ff-0191-4b38-a9a6-773519f4fd94 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.610212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.611305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.611990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.612826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.622271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.624141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.631746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565a3b6-f3a0-4244-a36b-f9e06acede96 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:20.639412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:20.640570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:20.641740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:20.650942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 391/789] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:20.651708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.716901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.717893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.718388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.718877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.739037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:20.747919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:20.748857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:20.749771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:20.756535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 399/790] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:20.761189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.814112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e07dae-f9c9-4987-b7ea-63254f11ac91 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.907255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.907886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.908174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.908454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.909205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:20.909514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.910976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.915206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ba223-58d0-465d-87fd-bee5f2923246 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:20.918505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:20.950346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:20.951305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:20.951865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:20.952347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:20.953198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:20.953761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:20.955339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:20.957059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 392/791] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:20.971334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 400/792] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:20.971536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.983653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:20.989916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.096497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9980df1-d3dd-44eb-bac5-39b9b62f8216 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.098169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c37216-0576-466b-8ea7-65d9cfa93a28 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.131726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.132375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.132647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.132763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.132941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.133527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.133807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.134077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.145065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.145339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.147148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.147346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-8f2b660b-8d18-4a55-892a-9b79c589f9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:21.161372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.162481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:21.163983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:21.163983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:21.163983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5eee47df-f3d7-49dc-a3e0-62c5b3dd2747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:21.164174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.165011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:21.165897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:21.165897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:21.165897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:21.167441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 393/793] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:21.168523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977003e-542f-4d7b-af37-dd25af723033 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.168797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977003e-542f-4d7b-af37-dd25af723033 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.169060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977003e-542f-4d7b-af37-dd25af723033 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.169803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 401/794] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:21.174852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 394/795] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:21.175099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adf001-c114-454c-971b-92638fef94fc None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.175099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adf001-c114-454c-971b-92638fef94fc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.175099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adf001-c114-454c-971b-92638fef94fc None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.175579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977003e-542f-4d7b-af37-dd25af723033 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.175736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 402/796] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:21.175736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adf001-c114-454c-971b-92638fef94fc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.194652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.239183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.280613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adf001-c114-454c-971b-92638fef94fc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.282481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977003e-542f-4d7b-af37-dd25af723033 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.319127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.319746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.320024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.320294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.320937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:21.321191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.321306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.321800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.322124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.322489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.322613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d6b0-7fdd-427e-abdb-be30b7ef114a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.323154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:21.323453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.324788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1343e-4bc4-416c-96ca-a2bcfceac3cd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.341019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 403/797] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:21.341198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 395/798] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:21.341279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.341279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.341438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.341513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.341582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.341582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.357228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:21.358354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:21.359807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:21.361007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:21.428488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 396/799] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:21.429525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.441049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 404/800] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:21.442079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.461172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.560312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9d339-4031-46b7-b53d-0ee1d88e22fe None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.579961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.600152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.600795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.601437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.601724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.609235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.610645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:21.624609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.625569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:21.626480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 405/801] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:21.638676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.697589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668273b-c674-44ef-b312-3e7dcdef3d09 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.707619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.737992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626287e-e2c5-4752-ad86-1db6525e328f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.760475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.761426 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.761904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.762372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.777079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.778356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.786334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.788077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.788549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.789031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.789926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:21.790561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:21.790693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.791609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:21.792711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:21.793255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.793328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 397/802] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:21.793328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.807927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 406/803] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:21.808914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.906212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141e74-c071-4f30-aa0d-2f68e4c866d8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.908945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df46e6-daa3-4a73-a999-470cb26d3aff None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:21.916035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.936832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:21.943512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.944327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.944458 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:21.944868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.945008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:21.945292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:21.945566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.945683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:21.946379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:21.948349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:21.955413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.958005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.959237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 11:45:21.960268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:21.961173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:21.962189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 407/804] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:21.963039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:21.964948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 398/805] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:21.965812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.075423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280e29-e02d-46cb-8377-bd189341f949 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.076282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01046c-92d6-4133-a1af-72fbb5628738 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.111845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.112448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.112731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.112942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.113067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.113587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.113745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:22.113893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.114045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.114143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/fae4b6d2e7f5478495814d5f392b2b27/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.115522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.116067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=fae4b6d2e7f5478495814d5f392b2b27, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.117463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.132663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 408/806] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:22.133726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.179085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.214543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 399/807] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:21 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/fae4b6d2e7f5478495814d5f392b2b27/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:22.214543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.254012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.254582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf08276-0646-4967-a39d-5c96c9c5e695 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.298098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.299799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.300088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.300359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.301103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:22.301408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.303381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.313397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 409/808] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:22.314375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.362316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e0a62-8cd0-487a-b132-804694228a36 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.405497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.406109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.406383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.406689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.407319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:22.407616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.408965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.415802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 400/809] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:22.416885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.438131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8df46e-b312-4f1e-8d3f-505cd0cba15f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.448070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.478995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.479616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.479944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.480226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.538971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.545646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210477a5-4351-4c5e-b16a-be6a7641638a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.552663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.554101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2a808-701f-4a6e-8cc5-99681d337023 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.580484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.581110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.581390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.581661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.592700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.594141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:22.609328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:22.610298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:22.611258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:22.611258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:22.611258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:22.611258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 401/810] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:22.611258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.667934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 410/811] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:22.669323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2267-d923-4230-ab3b-6070e9d6d82b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.669675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2267-d923-4230-ab3b-6070e9d6d82b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.670020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2267-d923-4230-ab3b-6070e9d6d82b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.674562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 411/812] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:22.674562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2267-d923-4230-ab3b-6070e9d6d82b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.683612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.731216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a192bb-aa02-4a37-a90e-38345155bcaf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.765703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.766309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.766621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.766896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.767531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:22.767830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.769190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.774581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 402/813] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:22.775361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.782427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2267-d923-4230-ab3b-6070e9d6d82b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.792563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.817016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.817649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.817929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.818211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.818888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:22.819193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.820549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6c15a-96a9-4f4d-a654-fdc5dc11db7e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.832513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 412/814] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:22.834236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.834562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.834820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.852698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:22.853882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:22.885045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c809b-13fa-46c2-bc4e-eb40934f7242 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:22.919372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:22.922130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:22.922865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:22.923129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:22.923429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:22.925297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 413/815] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:22.925830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:22.937847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:22.940151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:22.961467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:22.962396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:22.963316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:22.963316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:22.963316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:22.969878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 403/816] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:22.969878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.036993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.051505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279b4e4-633e-4f84-ad8d-492f9f2a6b54 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.074041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae10c5-3198-4212-9360-b262005d5302 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.097307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.098467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.099883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.100584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.101410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.103392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.114677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.115308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.115589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.115863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.124338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.125766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:23.138153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:23.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:23.140115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:23.141457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 404/817] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:23.142490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.211182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 414/818] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:23.212629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.265382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b0204-10e8-4bcb-b600-bf25b8722ec9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.297112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.299592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.316236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.317006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.317396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.318286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.319121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:23.319468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.321026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.341090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 405/819] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:23.342192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.365485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498701-9d84-4ea9-b76b-e0a9595a7e87 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.407823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.408852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.409142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.409415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.410473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:23.410806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.412265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.439468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 415/820] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:23.440303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.479772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dec9a1-bab0-4d12-99b2-326e11eaab77 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.520516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.521729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.522313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.522838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] PATH_INFO: `/v3/services/network` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.523676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.525273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:23.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:23.536227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 11:45:23.537141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:23.539998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 406/821] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:23.541084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.554587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad759-d084-4c99-b9f2-6c455de9341d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.569097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.590210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.590888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.591168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.591446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.598500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.600003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.601057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:23.612904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:23.623617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 416/822] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:23.624697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.657181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb889fb7-aa3b-4cb6-ae6a-9c6bf42e454c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.695154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.695793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.696074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.696346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.709272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.710759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.724422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c6126-7809-46fc-9131-d63743222cbd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:23.726137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:23.728265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:23.730338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:23.730338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:23.730338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:23.730338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 407/823] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:23.730338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.765671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.766282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.766584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.766859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.767488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] RBAC: Adding query filter params (name=network) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:23.767787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.769141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.774205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 417/824] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:23.775108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.821659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.837595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:23.843371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c51f40-6ff0-4d34-a910-3d0dec9dda26 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.881317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.882196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.882594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.883016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.884717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:23.885339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.887749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.903136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 408/825] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:23.904776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:23.913919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcef6f-3a6d-4269-a697-4a313b9764ce None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:23.959567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:23.960421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:23.961269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:23.961714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:23.962943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:23.963523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:23.965457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:23.982011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 418/826] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:23.983383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:24.039348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632411f-0ed6-47fa-a6ea-7a9b11b2751b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.085272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.085988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.086366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.086863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.087632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:24.088121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.089624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.100521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 409/827] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:24.100521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:24.103219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:24.109311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9d2ec-a909-4836-ad11-36d697baaf69 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.122074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:24.145343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.145963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.146483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.146614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.147307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:24.147614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.149028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.160091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 419/828] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:23 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:24.160091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:24.220936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623eee2-691a-48f7-a696-85155fe14ad4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.267632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.268754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.272255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.272255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.279289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.281247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5724ccf4-b5ce-4bb1-a5c1-683de009a7b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:24.296413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:24.301956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 410/829] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386bdf-13c0-47e5-abdf-32b70f2e1459 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.302930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386bdf-13c0-47e5-abdf-32b70f2e1459 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.303547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386bdf-13c0-47e5-abdf-32b70f2e1459 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.304980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 411/830] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:24.306012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386bdf-13c0-47e5-abdf-32b70f2e1459 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:24.307937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c4edb-f989-4c3c-a5bb-1a343c1645a3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.345225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.345841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.346114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.346384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.347085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.348447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b7f9f-a2aa-4b22-b302-92602f2abb25 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.404752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:24.426434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386bdf-13c0-47e5-abdf-32b70f2e1459 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.429813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 420/831] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:24.430037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.431867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.431867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.460850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:24.462099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:24.475477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:24.486381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.487269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.489517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.489517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.489517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:24.489517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.491065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.504661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 412/832] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:24.511216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:24.584940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 421/833] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:24.628171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b1eea-ec73-4bf4-bac1-e7f56ada6223 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:24.666506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:24.667453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:24.667925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:24.668362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/21f021f13320436c95800de92d844fd7/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:24.672272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:24.685913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=21f021f13320436c95800de92d844fd7, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:24.687611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:24.764596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 413/834] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:24 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/21f021f13320436c95800de92d844fd7/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:24.915233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.023621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242d5a-7239-4975-8577-fc9ca0c9eea4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.059037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c566-76ef-4786-87c2-509900579810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.060085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c566-76ef-4786-87c2-509900579810 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.060562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c566-76ef-4786-87c2-509900579810 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.061046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c566-76ef-4786-87c2-509900579810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.072252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950c566-76ef-4786-87c2-509900579810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1950c566-76ef-4786-87c2-509900579810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:25.077180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:25.078103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:25.078958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:25.081635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 422/835] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:25.087812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.211274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48f2c3-3c30-4851-a281-163a6085bfbc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.249805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.250415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.250725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.251001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.253950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:25.254271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:25.256970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d8dc4-490e-48a7-859b-d70d74e06416 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:25.267353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 414/836] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:25.282413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c566-76ef-4786-87c2-509900579810 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.283713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:25.329865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6322b7-a1c4-420e-b0e0-6fe778c858ab None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.330175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6322b7-a1c4-420e-b0e0-6fe778c858ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.330476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6322b7-a1c4-420e-b0e0-6fe778c858ab None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.332078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 415/837] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:25.337422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.338004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.338499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.358692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:25.360212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:25.401858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950c566-76ef-4786-87c2-509900579810 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.420617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:25.450106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.450954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.451559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.451942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.455533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 416/838] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:25.475535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:25.475535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:25.492148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:25.493332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:25.494247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:25.494247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:25.494247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:25.494938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 423/839] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:25.501195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.615359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c032f7a-37bd-4172-9415-6322c935667d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.653355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.653971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.654250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.654542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.655184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:25.655483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:25.656847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:25.670734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 417/840] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:25.676040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.750579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:25.766358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.795710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f947f-5ff8-4755-a20c-3ea48153a0cc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.809859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:25.829596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.830099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.830374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.830688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.839008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:25.840441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:25.854194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:25.855216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 11:45:25.856159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:25.858765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 424/841] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:25.864616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.880832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ebafd-ac34-4d24-a12f-213402d2c102 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:25.925489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:25.926154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:25.926693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:25.927004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:25.927593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:25.929428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:25.940253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:25.941230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:25.942112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:25.946678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 418/842] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:25.947958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:25.985885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda066-3d9b-46be-8dc8-19d362fc5575 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.004289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.022684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.023610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.024094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.024587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.025500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:26.025999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.027649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.046394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 425/843] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:26.052607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.077082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a2b7-293b-45bf-8a8d-388c7fc42130 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.077691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.119804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.120440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.120685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.120925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.121554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:26.121851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.123246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.132548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 419/844] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:26.135091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.181795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37b86f-98ba-4c5f-95ff-2c90bb1573ac None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.217443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.218470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.218998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.219468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.252376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb60f-42ce-444e-9cb4-55fee97ec9b9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.269262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.292167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.292963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.293422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.293882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.295016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:26.295320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.295642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.296691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55981-3975-4f76-a909-df10a3afc663 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.298313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.306902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 420/845] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:26.388741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7d01-89e4-47e3-b97b-991df1ad42dc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.389098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7d01-89e4-47e3-b97b-991df1ad42dc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.389288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f7d01-89e4-47e3-b97b-991df1ad42dc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.390991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 421/846] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:26.396588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.396888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.397141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.416462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:26.417794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:26.421116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 426/847] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:45:26.427494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.449059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.521304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.523444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 422/848] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:26.550921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffe44-a0ef-4147-a429-f93f5a209a81 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.586186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.586859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.587186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.587457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.598392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.600645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:26.615239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:26.616201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:26.617113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:26.617113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:26.617113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:26.617113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 427/849] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:26.622410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.731797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfde8cb-7992-4e03-9f42-2ab1a9ae5cc1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.766188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.766823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.767103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.767377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.768021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:26.768320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.769681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63707f5-60d2-4ea0-8994-9d12fbec8f27 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.782025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 423/850] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:26.787707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.811228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a1d9-8b59-4bea-b102-9bcb1cbcfd9d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.811549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a1d9-8b59-4bea-b102-9bcb1cbcfd9d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.811779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2a1d9-8b59-4bea-b102-9bcb1cbcfd9d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.813221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 424/851] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:26.818167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.818448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.818752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.837780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:26.839283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:26.854770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.899569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b305522-bd95-4aff-935b-e3dfc58d9993 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:26.910594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 425/852] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:26.910594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:26.938997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:26.949283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:26.950132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:26.951057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:26.951732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:26.960983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:26.962964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:26.977868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:26.978814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:26.979706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:26.982654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 428/853] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:26.985301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.021486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6733f-c33f-47f7-bcd2-8f3077a2f199 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.056675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.057320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.057836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.057946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.058539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.059916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:27.070392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:27.071374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:27.077351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 426/854] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:27.078162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.095278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:27.120676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a75b0-bf74-4633-8709-8280ae1666e2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.158217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.158689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.158971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.159244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.159941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.160247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.161704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.178679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 429/855] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.181008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.198927 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519d4c7-f00c-4eb6-8c55-32f28ff10303 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.231352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:27.236183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.236795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.237075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.237349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.237977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.238280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.240212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.245179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 427/856] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.246021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.289947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556702-633e-4ecb-bb49-de420ab5ba50 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.326811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.327771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.328048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.328317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.330305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:27.339839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:27.344965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:27.345905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:27.346801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 430/857] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:27.347524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.357593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd94e89-d56e-4643-b91f-3fc1b6cc19a9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.397183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.397786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.398068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.398340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.399100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=fae4b6d2e7f5478495814d5f392b2b27) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.399414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.400857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.406947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 428/858] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/role_assignments?user.id=fae4b6d2e7f5478495814d5f392b2b27&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.419587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.472707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac72db-6786-4303-b972-1d5664c3ddbd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.491562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:27.529328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.530338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.530964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.531425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.532610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.533063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.534700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.543128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 431/859] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.555893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e6170-9d06-4b3c-ad2e-d66b059b82d0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.596069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.596703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.596980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.597251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.597944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.598247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.600243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.610859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 429/860] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.617400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.726096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e08e6-85f5-43e4-9806-032914bd5aac None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.761618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.762243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.762582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.762854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.773623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.775080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:27.789804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:27.790846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:27.791755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:27.791755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:27.791755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:27.794658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 432/861] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:27.797232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.801341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:27.905385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c415d4-6c33-4c99-89ad-ec6435b40006 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:27.940940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:27.941546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:27.941819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:27.942091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:27.942834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:27.943132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:27.944487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:27.961848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 430/862] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:27.963193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:27.991795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:28.068560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c155-448d-42a4-88b7-d446aed5ad10 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.108431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:28.109061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.109333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.109601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.117197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:28.118648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:28.131704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:28.134510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:28.136835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:28.138355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 433/863] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:28.142133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:28.202968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:28.243261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a658c83-7aef-4468-91a7-be8c8841786b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.279131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:28.279736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.283048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.283048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.283048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:28.283048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:28.283048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff242a-1f0e-4350-8fc9-5774f701d292 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:28.306481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 431/864] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:28.308040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:28.310650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0151f-22ad-425e-8309-e21f8857ccf1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.311154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0151f-22ad-425e-8309-e21f8857ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.311626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0151f-22ad-425e-8309-e21f8857ccf1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.313428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 432/865] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:28.319601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.320118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.323138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.338593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:28.340034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:28.414542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:28.414843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 433/866] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:28.429584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da366-37e0-43a8-a2f5-67f90f9ac62b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.464602 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:28.465140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.465415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.465687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.536582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:28.538013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:28.625706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:28.647665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 434/867] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:28.649856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:28.691514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:28.709680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:28.780119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481585b2-8bd9-4968-8f6e-ca842282aa0b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.802865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a6870-6f0a-4992-b585-cf353054c979 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.820308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:28.820941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.821224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.821497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.832172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:28.834144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:28.847683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:28.849163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:28.849636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:28.849823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:28.850746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:28.851664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:28.851664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:28.851664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:28.852647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:28.853495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:28.855080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:28.855697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 434/868] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:28.856496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:28.927230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 435/869] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:28 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:28.986862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93904-4347-4f6d-9175-825071c04ec5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:28.989861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:29.034815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:29.035357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.035639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.036501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.037161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:29.037519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:29.038946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:29.052590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:29.058241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:29.110081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:29.169496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b52f9-f5a2-4945-8fde-efe17da1049c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:29.205808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:29.206443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.206754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.207031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.214609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:29.216046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:29.227593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:29.228509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:29.229836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 436/871] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:29.234780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:29.342318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d089598-55d7-406a-80e1-da1a377693a8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:29.376725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:29.377338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.377620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.377894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.378631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:29.378938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:29.380959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ff0cc-c1be-4d38-bbc6-f7fb3ee323f0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:29.395201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 436/872] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:29.401714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:29.457497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e042c4-8ab6-4b03-989c-e396687fcaf1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.458354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e042c4-8ab6-4b03-989c-e396687fcaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.458631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e042c4-8ab6-4b03-989c-e396687fcaf1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.460315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 437/873] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:29.465491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148236-0b3c-4238-8411-fb56b495ac20 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.465863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148236-0b3c-4238-8411-fb56b495ac20 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.466146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148236-0b3c-4238-8411-fb56b495ac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.484590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6a148236-0b3c-4238-8411-fb56b495ac20 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:29.485894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6a148236-0b3c-4238-8411-fb56b495ac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:29.502884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:29.517167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410ee21-fc62-4baf-8875-cd3729f8ada6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:29.521074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:29.566557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 438/874] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:29.570309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:29.571144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.571783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.572209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.573259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=21f021f13320436c95800de92d844fd7) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:29.574041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:29.575644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:29.579453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2a895-6e53-4518-9826-3bc3b5218e9b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.579902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2a895-6e53-4518-9826-3bc3b5218e9b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.580322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2a895-6e53-4518-9826-3bc3b5218e9b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.582038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 439/875] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:29.583252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 437/876] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:29 2022] GET /identity/v3/role_assignments?user.id=21f021f13320436c95800de92d844fd7&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:29.587603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.587887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.588164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.607817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:29.609102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:29.689543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 440/877] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:29.846987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:29.951712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18098-4d7c-4c6a-8dd9-b308191328d2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:29.963846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:29.998097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:29.998771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:29.999053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:29.999328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:29.999913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:30.001274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:30.010664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:30.011724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:30.012567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 438/878] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:30.019509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:30.055727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:30.068361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:30.091587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89cc22-8c4d-4836-adcc-e92b7a0827f8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:30.131419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e8ee9-5fed-4eb7-aea6-23426b2d789e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:30.137762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:30.138377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:30.138714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:30.138983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:30.139654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:30.141021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4042a-f78a-479e-ae57-14710e5c9558 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:30.171612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:30.172409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:30.172758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:30.173102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:30.173809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:30.174177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:30.175662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:30.181304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 439/879] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:30.186574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:30.236259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 441/880] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:29 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:30.298691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:30.306006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63c90-fdf3-4707-9c88-653052a7fcc9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:30.352007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:30.352628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:30.352899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:30.353174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:30.353808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:30.354111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:30.355606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c85707-75ad-4738-bfe6-466093c7edb7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:30.361237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 440/881] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:30.994664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90602-6e6b-475a-9235-b0180b06a616 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:30.995019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90602-6e6b-475a-9235-b0180b06a616 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:30.995223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90602-6e6b-475a-9235-b0180b06a616 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:30.996804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 442/882] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:31.001849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.002135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.002410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.021468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:31.022684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:31.093837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 441/883] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:31.361316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90602-6e6b-475a-9235-b0180b06a616 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:31.469726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90602-6e6b-475a-9235-b0180b06a616 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:31.506459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:31.507123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.507400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.507669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.508518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:31.509880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5cb9a42f-3aa6-4427-8e40-93a260722c33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:31.518659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:31.519605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:31.520870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 443/884] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:31.526963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:31.672061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ccc3-794d-4781-bf27-aa4c7088e80c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:31.673745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:31.708117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:31.708748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.709028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.709304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.710016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:31.710322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:31.714540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d965ad-82d6-4c79-9b25-b8553e5c2cc6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:31.714684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299990d-e0c2-49b0-b887-b79e3f7b10e1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.714684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299990d-e0c2-49b0-b887-b79e3f7b10e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.714684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299990d-e0c2-49b0-b887-b79e3f7b10e1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.717516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 442/885] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:31.717759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 444/886] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:31.728042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.728422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.728771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.736332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299990d-e0c2-49b0-b887-b79e3f7b10e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:31.748165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:31.749372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:31.757310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:31.860208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 443/887] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:31.915561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299990d-e0c2-49b0-b887-b79e3f7b10e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:31.952118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:31.952691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:31.952978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:31.953303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:31.953941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:31.954244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:31.955691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:31.961698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 445/888] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:31.977380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.135646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.142765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.156305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a958-9eae-45ca-8454-5258c3820e13 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.193477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.194580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.195163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.195577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.196422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] RBAC: Adding query filter params (interface=public, service_id=d42aae1ef0354d638c19fe74c107c053, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:32.196871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.198753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.208972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 444/889] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:31 2022] GET /identity/v3/endpoints?service_id=d42aae1ef0354d638c19fe74c107c053&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:32.211017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.218068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.261029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789480b1-1f4a-4423-8434-922713bb2eac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.298195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.299022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.299332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.299584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.311084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:32.315998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c79feb-2979-4962-8afd-9756eca79824 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d6867823-8248-4d45-900e-8eaa25c5d6d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:32.316118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:32.317582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:32.318438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:32.319960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 446/890] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:32.321436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13217-d14a-4029-8f06-a9ae4e9b75aa None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.321724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13217-d14a-4029-8f06-a9ae4e9b75aa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.322142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13217-d14a-4029-8f06-a9ae4e9b75aa None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.324538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 447/891] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:32.326812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13217-d14a-4029-8f06-a9ae4e9b75aa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.368042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.369025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.370014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.370501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.371332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.373702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c9dac-809d-491c-9952-6cebf794bab7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.382134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 445/892] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:45:32.384321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0f24b-2832-4990-9a86-f7c5b080e679 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.384946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0f24b-2832-4990-9a86-f7c5b080e679 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.385501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0f24b-2832-4990-9a86-f7c5b080e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.412677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-11c0f24b-2832-4990-9a86-f7c5b080e679 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:32.413994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-11c0f24b-2832-4990-9a86-f7c5b080e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:32.423267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.459171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13217-d14a-4029-8f06-a9ae4e9b75aa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.496789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.505663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.506285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.506584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.506857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.507530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:32.508084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.509461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.510921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 446/893] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:32.512375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343928-8f0b-40cd-bb4f-f7643cf50772 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.512669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343928-8f0b-40cd-bb4f-f7643cf50772 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.512947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343928-8f0b-40cd-bb4f-f7643cf50772 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.518578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 447/894] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:32.519815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.520130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.520406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.523334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 448/895] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:32.529663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.545941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:32.547245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:32.625016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 448/896] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:32.650003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0098c-4ec7-4ec6-974a-5561dc3cde1a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.684749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.685372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.685646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.685911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.697468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.699045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:32.713315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:32.714263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:32.715197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:32.715197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:32.715197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:32.715197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 449/897] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:32.723753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.777976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.793185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.824390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:32.832099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecccf-b0ba-49b3-afa4-32d33268a625 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.868457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.869062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.869339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.869608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.870242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:32.870557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.871926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.884700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 449/898] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:32.889837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:32.899947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747d3c0-9f5b-4eea-85c0-3b2aaea723bb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:32.942450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:32.943094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:32.943365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:32.943689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:32.944279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:32.945636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:32.954727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:32.955643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:32.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 450/899] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:32.963033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.005606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bb6c-5d5c-4a1d-b5df-8484183ca0c1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.032883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.040771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.041394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.041669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.051959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.051959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.051959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:33.062230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:33.063483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 450/900] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:33.064463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.067854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3b2bc-c1dc-42b4-8f3b-1380a8178dec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.076111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.108661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.109265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.109540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.109854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.110649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.112135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.167952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5a13-7b54-485a-b1f7-7dc87c6afb4d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.196160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 451/901] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:32 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:33.196160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.227097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.227790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.229138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.229759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.230815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:33.231124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.235347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.245342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 451/902] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:33.248147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.318728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a7a92-401a-48b2-91dc-6e6f44dee9bb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.323024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.359745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.360357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.360636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.360902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.361870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:33.361976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.363447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.383759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 452/903] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:33.389659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.390794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2b4c6-957e-4fd7-83a7-d9cb13949749 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.418981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.438269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.439310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.439592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.439862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.440774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:33.441083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.442639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.449678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 452/904] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:33.458684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.503026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b6fec-6402-4ab4-a904-8ef47ee97bdc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.541902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.542819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.543244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.543654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.577326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ebff1-be0e-4c17-a323-5076cb4d73be None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.591578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.615229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.615968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.616349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.617159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.617884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] RBAC: Adding query filter params (interface=public, service_id=75eaf625ab334377ac93b12baf256e09, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:33.618437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.619269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.619883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.621178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.626274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 453/905] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/endpoints?service_id=75eaf625ab334377ac93b12baf256e09&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:33.632179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.649392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.738357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 453/906] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:45:33.739448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:33.762979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e18b9-dbab-4158-8a0a-2bd5e17e64eb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.804944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.805558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.805834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.806105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.806736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.808102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.814571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 454/907] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:45:33.883344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead84b-35c1-429a-8b40-9129029b85d0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:33.910875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:33.922608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:33.926225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:33.926225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:33.926225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:33.936459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:33.937944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:33.955033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:33.956076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:33.957278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:33.957278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:33.957278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:33.957278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:33.962436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:34.011055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:34.071022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a8ec-cea8-4739-a839-444703491abc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:34.106308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:34.107275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.107725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.108166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.108998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:34.109468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:34.111020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:34.130630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:34.133200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:34.245056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b941e-ca72-4762-8179-907f2dd3075a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:34.280324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:34.280963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.281245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.281520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.288768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:34.290225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2945e3d8-72cf-437b-b2ac-21636d1514f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:34.303579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:34.304569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:34.306164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 455/910] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:34.310652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:34.419380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:34.422427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716766-dd45-4656-9cf4-696a65a5bc58 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:34.434329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c4d-d4fb-454f-bdf2-0d582cc65345 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.434645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c4d-d4fb-454f-bdf2-0d582cc65345 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.434924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0c4d-d4fb-454f-bdf2-0d582cc65345 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.436492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 456/911] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:34.441331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.441641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.441905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.459796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:34.460407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.460684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.460956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.461646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:34.462072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:34.463516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:34.475849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:34.478008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:34.479856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 456/912] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:34.485713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:34.514742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:34.574989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 457/913] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:34.600012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2edf8-9dcc-46c8-b625-ff067b225007 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:34.638420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:34.639242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.639665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.640103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.640965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] RBAC: Adding query filter params (role.id=a9d9e6298f1844018b2c971078a7bbf5, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=21f021f13320436c95800de92d844fd7) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:34.641417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:34.643011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:34.648910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 457/914] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:34 2022] GET /identity/v3/role_assignments?user.id=21f021f13320436c95800de92d844fd7&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=a9d9e6298f1844018b2c971078a7bbf5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:34.849780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:34.949790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9be12-e5e3-4592-bd4a-4996e17a85c9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:34.985641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:34.986583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:34.987008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:34.987452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:34.988202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:34.989808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:34.999240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:35.000452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 11:45:35.001493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:35.003905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 458/915] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:35.010121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:35.043202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:35.118940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf432a1-66ae-439c-b585-cd3375470f75 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:35.155083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:35.155942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.156363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.156776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.157544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:35.158021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:35.159539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b3c9f-06a9-4825-95d6-6f6cb2486cff None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:35.164874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 458/916] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:35.170692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:35.203053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:35.282194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517a483-8ef0-497b-bc35-6fcdfe775e37 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:35.289859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460289-149a-47a9-b6b0-b82b55d45a8d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.290148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460289-149a-47a9-b6b0-b82b55d45a8d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.290420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87460289-149a-47a9-b6b0-b82b55d45a8d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.292169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 459/917] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:35.297302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.297588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.297867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.315806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:35.317529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:35.322123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:35.322968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.323398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.323826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.324601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:35.325047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:35.326593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:35.332923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 459/918] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Aug 12 11:45:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:35.338067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:35.414757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 460/919] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:35.458289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:35.465665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe01d-d9a8-449e-be49-e611c77e6e0e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:35.501335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:35.501953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.502232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.502506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.503216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:35.505215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24432337-c745-4d76-ac66-579c74d9e4f0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:35.587453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 460/920] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:35.714978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:35.741358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:35.828713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff362df-38ef-4bd1-ad29-f58afc12d9da None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:35.854710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077f59-1182-47f2-bd01-5a828c8b3967 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.855072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077f59-1182-47f2-bd01-5a828c8b3967 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.855274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077f59-1182-47f2-bd01-5a828c8b3967 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.856601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 461/921] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:35.862600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.862955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.863303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.870644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:35.871680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:35.872968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:35.873423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:35.874172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:35.875718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:35.886505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:35.887087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:35.888032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:35.888907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:35.889662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:35.896035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 461/922] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:35.897460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:35.967099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 462/923] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:35.998918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.021335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150269d6-bda1-47a9-8412-cfed44687cfb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.062068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.063104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.063586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.064091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.064966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:36.065468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.067157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.076187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 462/924] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:36.078650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.169316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.189737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ecfb4-deee-48ed-af97-7fc456cea5c5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.225803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.226339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.226673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.226948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.227585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:36.227890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.229257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.234797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 463/925] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:36.242226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.288847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.372358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7b03-1a30-4126-84fb-d883c4b1454e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.413010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82321d-77f4-4d4f-b197-45507f2466e1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.417527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.418144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.418426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.418730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.419433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] RBAC: Adding query filter params (interface=public, service_id=fee6d4884d8d4dfaab30e165a1a5c637, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:36.419741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.421158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.429345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 463/926] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/endpoints?service_id=fee6d4884d8d4dfaab30e165a1a5c637&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:36.436863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.449134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.463740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.465225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.465724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.466471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.467321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.469710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:36.482552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:36.483693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 11:45:36.484801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:36.491267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:36.493585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.506378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.560073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc885-1bdd-47c7-ad61-02b525fcc118 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.596608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.597224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.597502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.598329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.599078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.600443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090db79e-64dc-4a26-95ed-44576c622c38 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.605233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d5da-cdca-4f25-a515-2ed87fb04850 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.614876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 464/928] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:45:36.618571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a93-bc99-4ab9-8ea7-b80d541dddb0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.618571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a93-bc99-4ab9-8ea7-b80d541dddb0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.618571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e6a93-bc99-4ab9-8ea7-b80d541dddb0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.618571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 465/929] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:36.624063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.624353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.624734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.648335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:36.649585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:36.650978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.654752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.655152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.655526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.656288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:36.656692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.658230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.668879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:36.670193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.740907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.747920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 466/931] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:36.768563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:36.805677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71d343-b7de-4327-a3c0-64efd7304dcf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:36.844938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:36.845945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:36.846435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:36.847006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:36.847871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:36.848398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:36.849976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:36.855762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 466/932] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:36.863987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:36.967610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792549a-2a38-446c-92ca-21c5efe28e87 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.004947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.005777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.006195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.006650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.007753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:37.009327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:37.064736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:37.117450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 467/933] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:37.188527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1a570-f215-433b-9a8f-09bfb17f7aa5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.228395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:37.236272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.237291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.237730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.240767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.251742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:37.257986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:37.259041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:37.259890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:37.263432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:37.274091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:37.331707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:37.378687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70338c-cb6c-453b-b01c-947af0dad7e1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.413569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.414478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.414973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.415481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.416315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:37.416786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:37.418299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:37.427983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:37.434404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:37.539520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88d3fe-c760-4aa4-9a94-55dc38c47af2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.573827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.574457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.574761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.575037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.586001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:37.587481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b41a0e78-94f5-4f18-8af1-bb3c5d5673fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:37.602307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:37.603320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:37.604343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:37.604343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:37.604343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:37.608277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:37.609670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:37.659623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d797b-9e49-403a-b415-a6f499006f1d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.659957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d797b-9e49-403a-b415-a6f499006f1d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.660708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d797b-9e49-403a-b415-a6f499006f1d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.662162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 469/937] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:37.668411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.668691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.668964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.687384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:37.688614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:37.723612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426033-8891-4b4e-98e6-259cf873c630 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.730914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:37.760314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.761124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 470/938] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:37.766739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.774695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:37.775751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.776187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.776990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:37.777422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:37.778955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:37.792145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 469/939] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:37.797612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:37.900410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470be2d-102d-44bc-be38-958a62324c90 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:37.937504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:37.938140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:37.938420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:37.938722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:37.945836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:37.947313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:37.959171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:37.960250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:37.961268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:37.965100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 471/940] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:37.966438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.065530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.070464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0108a-196b-44e6-b140-973268395d27 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.103939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.107845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.108719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.109198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.109671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.110626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:38.111131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.112834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.131456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 470/941] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:38.137486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.189142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8afcf1-6080-49bc-881c-325575fd0a85 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.193347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.225980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.226365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.226676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.226949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.227595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.229019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.231706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING keystone.server.flask.common [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 11:45:38.255239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976dccf-c336-4c80-be10-41ae78ff0aa5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.283052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.sql.core [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:45:38.283052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:45:38.283052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [parameters: {'id': '64baae33778d41f5a815823fea892c83', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:45:38.283052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81657) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:45:38.291997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.292730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.293036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.294017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64baae33778d41f5a815823fea892c83.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64baae33778d41f5a815823fea892c83. Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:45:38.295251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 12 11:45:38.296072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application yield resource Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise self.value Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application session.commit() Aug 12 11:45:38.297054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:45:38.298003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:45:38.300030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:45:38.301602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [parameters: {'id': '64baae33778d41f5a815823fea892c83', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.308003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:38.309040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64baae33778d41f5a815823fea892c83. Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.310161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 472/942] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Aug 12 11:45:38 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:38.312373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.315455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.318794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:38.337203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:38.338189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:38.346834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:38.346834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:38.346834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:38.346834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 471/943] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:38.346834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.427659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.437737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adfb49-2e5e-45d7-bdeb-1e955bbb4d1d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.447365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.462431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73707d-40e0-492d-8718-ba0007e9c94c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.483993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.484843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.485295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.485743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.493678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.495575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.501968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.502802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.503157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.503503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.504784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:38.505157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.506639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:38.509469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:38.510357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:38.511321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:38.513805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 473/944] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:38.521220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.531571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 472/945] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:38.532915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.627820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09d60b-c144-428e-be3f-ffe12bdc0d31 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.640752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d7ccc-d5a4-4b19-a81d-8495a2ba8ced None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.664092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.664994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.665267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.665650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.666323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:38.666658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.668082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472ced-1564-4d7b-af99-0694a1641367 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.677880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.678782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.679215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.679488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.686346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.687851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.689054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 474/946] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:38.690144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b983-0c8f-4a2d-82bb-4d15c40d39b7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.690432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b983-0c8f-4a2d-82bb-4d15c40d39b7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.690726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b983-0c8f-4a2d-82bb-4d15c40d39b7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.692674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 475/947] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:38.698199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.702765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.703332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:38.708922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:38.710114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:38.711292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:38.713513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 473/948] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:38.720535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:38.732831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:38.734666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.734918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:38.741350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:38.817895 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 476/949] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:38.861533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b00e3-36f2-4b98-a9ce-555c8500d9bc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:38.899641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:38.900343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:38.900720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:38.901089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:38.901881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:38.902278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:38.903810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:38.917688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 474/950] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:38.923935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.037653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06767e-122c-44a5-96f3-6ac8e4406e5a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.073394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.074362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.074827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.075259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/21f021f13320436c95800de92d844fd7/roles/a9d9e6298f1844018b2c971078a7bbf5` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.077566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=21f021f13320436c95800de92d844fd7, role_id=a9d9e6298f1844018b2c971078a7bbf5)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.079189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248884c-66f4-43bb-9df2-9f20b19c96de None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.089585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.161901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:39.181460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:39.186226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 477/951] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:38 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/21f021f13320436c95800de92d844fd7/roles/a9d9e6298f1844018b2c971078a7bbf5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:39.187753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75243-cc38-4d80-ada3-5a8806e4df95 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.190894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75243-cc38-4d80-ada3-5a8806e4df95 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.190894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a75243-cc38-4d80-ada3-5a8806e4df95 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.190894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 478/952] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:39.195839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.196238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.196632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.204493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54e88f-79af-4675-9a91-78a780bf6475 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.216227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:39.217824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:39.249336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.250279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.250637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.251014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.251727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.253510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:39.264078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:39.265563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:39.266774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:39.269144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 475/953] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:39.275460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.330963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 479/954] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:39.403339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36140-b30e-4e88-8f6c-cbd93d5c0e44 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.435336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:39.441052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.441811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.442223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.442655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.443405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:39.443890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.445347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.451162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 476/955] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:39.456488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.565035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db7de3-689f-4e4a-82c2-293c9d77a699 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.596978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:39.600811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.601425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.601703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.601979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.602684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:39.602997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.604410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.609556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 480/956] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:39.615354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.631364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.747802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c881a-8b9d-4df7-91ea-d01614d69326 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.747995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384832da-9985-4c0c-a949-70746f125bcc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.786412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.787330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.787454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.787806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.788459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.789866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.793896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.794779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.795254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.795716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.796573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.798143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:39.799456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:39.800472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:39.801386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 481/957] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:39.808601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:39.870236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:39.895506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 477/958] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:39.925412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d4d6-6599-4ab5-9dac-c64869a3a586 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:39.969579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:39.970191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:39.970470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:39.970771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:39.971410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:39.971715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:39.973637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1a91c-cd13-47db-ad77-520a35ad581a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:39.979574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 482/959] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:39.985290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:40.043686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:40.090995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd688f-852a-4e09-87cc-39986075c2fa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:40.126107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:40.126756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:40.127040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:40.127319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:40.127957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:40.128263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:40.129717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8213f-6b00-4762-90d9-d0c582ae037b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:40.134724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 478/960] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:40.764516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b64e0-b16e-489e-ba3a-3c72f3fee347 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:40.765011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b64e0-b16e-489e-ba3a-3c72f3fee347 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:40.765011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b64e0-b16e-489e-ba3a-3c72f3fee347 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:40.766592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 483/961] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:40.771771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989354e3-45fc-45c6-9a7c-0634340e56b5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:40.772057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989354e3-45fc-45c6-9a7c-0634340e56b5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:40.772332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989354e3-45fc-45c6-9a7c-0634340e56b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:40.790096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-989354e3-45fc-45c6-9a7c-0634340e56b5 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:40.791315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-989354e3-45fc-45c6-9a7c-0634340e56b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:40.860528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 479/962] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:41.131280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b64e0-b16e-489e-ba3a-3c72f3fee347 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.186248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df7a1-d06b-4a15-b592-8cca7a2b7f16 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.186814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df7a1-d06b-4a15-b592-8cca7a2b7f16 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.186814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df7a1-d06b-4a15-b592-8cca7a2b7f16 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.188437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 480/963] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:41.193393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.193683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.193963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.211999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:41.213191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:41.237403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b64e0-b16e-489e-ba3a-3c72f3fee347 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:41.265168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:41.272914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:41.284739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:41.286094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.286954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.287393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.288460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:41.290561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:41.301192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 481/964] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:41.354292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.sql.core [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:45:41.354292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:45:41.354292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [parameters: {'user_id': '785103855eb440bd87adaf3df3c4e8e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:45:41.354292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81657) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:45:41.361755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:45:41.362694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application yield resource Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise self.value Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application session.commit() Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 11:45:41.364342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.flush() Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application compat.raise_( Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 11:45:41.365263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 11:45:41.366197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 11:45:41.367136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [parameters: {'user_id': '785103855eb440bd87adaf3df3c4e8e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:41.367985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 12 11:45:41.368798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:41.369807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 484/965] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Aug 12 11:45:41 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:41.378316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.485122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8718-021a-4d4e-9609-aed083dd2b4b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:41.520890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:41.521524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.521805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.522077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.529342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:41.530802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:41.542972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:41.543985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:41.544947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 482/966] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:41.550275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.585106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.623797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:41.684580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1ddad-a804-4a5f-ab48-d4ef71145b4c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:41.703157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3284aa0-c958-431b-8125-f6dc5303f077 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:41.731219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:41.731753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.732032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.732310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.733279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:41.733639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:41.736148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9438db-3ed6-46e0-8307-1d976a855682 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:41.743072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:41.743951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.744431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.744940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.756187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:41.761467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:41.762443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:41.763622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:41.771265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 483/967] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:45:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:41.772724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.781166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 485/968] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Aug 12 11:45:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:41.890502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:41.898439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a717-5e1b-4f3d-b84c-b127a258d12c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:41.935604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:41.936217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.936494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.936769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.937439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:41.937742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:41.939237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3e9fb-1f0d-4b98-a469-0e3864aae4c2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:41.948029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f0c7-cf96-4a58-983e-38b7ec14a39a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.948473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f0c7-cf96-4a58-983e-38b7ec14a39a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.948748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382f0c7-cf96-4a58-983e-38b7ec14a39a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.949748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 484/969] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:45:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:41.950072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 486/970] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:41.955278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add55d-1bc6-4558-aa57-8478185e8e68 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:41.955565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add55d-1bc6-4558-aa57-8478185e8e68 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:41.955848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add55d-1bc6-4558-aa57-8478185e8e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:41.957420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382f0c7-cf96-4a58-983e-38b7ec14a39a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:41.980256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-64add55d-1bc6-4558-aa57-8478185e8e68 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:41.981171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-64add55d-1bc6-4558-aa57-8478185e8e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:42.016349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.060253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 485/971] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:42.092251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382f0c7-cf96-4a58-983e-38b7ec14a39a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.127997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.129576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.130066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.130566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.135799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0714b-fb07-45de-bbb2-2604a22042b3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.136094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0714b-fb07-45de-bbb2-2604a22042b3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.136375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0714b-fb07-45de-bbb2-2604a22042b3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.137854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 486/972] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:42.141884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.142469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.142785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.143064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.143364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:42.159085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:42.160134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:42.166025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:42.166025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:42.166025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:42.166025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 487/973] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:42.166347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:42.166347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:42.167814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.242576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 487/974] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:42.287776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.287776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d421b-cfbf-48de-9c45-aa6e4c0e4eeb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.318433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.319070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.319351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.319626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.320263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:42.320568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.322019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.334579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 488/975] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:42.336403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.341116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.356794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.439703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee450-3c88-4cea-b4fc-0f77b57fadcb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.442565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbccde-ad18-403a-a92f-47eb51d8d291 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.477960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.478626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.478909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.479172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.479755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.481112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.484945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.485592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.485885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.486163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:42.490747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:42.491750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:42.492624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:42.494759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.496186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.496877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 488/976] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:42.497601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:42.508707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:42.509761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:42.511703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 489/977] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:42.515244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.527745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.582362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.599674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369cb85-0824-4e88-90eb-c4e7dd9b0281 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.615382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4104a0-3837-4588-b140-6eb07656b2cc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.634878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.635475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.635750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.636021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.636641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:42.636942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.638284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.642787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 489/978] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:42.643523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.652559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.653158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.653430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.653695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.654415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:42.654740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.656131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.673387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 490/979] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:42.674150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.736604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.741327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4b0a-43fc-49d7-9b18-dc420cd9d5e4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.769305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24993b56-0fa2-4f43-908e-db9ba1bf2471 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.774142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.774767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.775047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.775316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.775946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.777294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.803097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.803706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.803954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.804221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.804839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:42.805137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:42.806477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:42.811250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 491/980] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:42.812008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.838681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 490/981] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:42 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:42.838681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:42.844540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.922102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163a40-e85c-4390-910d-5f9aa07f7fbc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.953136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:42.956841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8bd42-0eab-433d-be5f-4859361ce4dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:42.960058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.961082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.961082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.961453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:42.997961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:42.998600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:42.999022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:42.999295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.000609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] RBAC: Adding query filter params (interface=admin, service_id=fee6d4884d8d4dfaab30e165a1a5c637, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:43.000609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.001633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.009869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 491/982] 10.222.0.18 () {56 vars in 1249 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/endpoints?service_id=fee6d4884d8d4dfaab30e165a1a5c637&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:43.015734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.038290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.039812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.087727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:43.123647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9795-a09d-4173-98ef-d410c90c4d41 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.153355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 492/983] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:42 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:43.155094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.162751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.163787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.164067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.164339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.164945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.166987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.173843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 492/984] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:45:43.186116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:43.262176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd3cb0-bbdc-48fe-bdbf-986eb3306c0f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.300682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.301324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.301598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.301864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.313560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.315056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:43.332498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:43.333508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:43.334432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:43.334432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:43.334432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:43.334432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 493/985] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:43.339407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.442810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ff2ab-cb16-4d7d-a1bf-a27676215348 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.472161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:43.477700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.478365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.478665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.481841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.481841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:43.481841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.481841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.493477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 493/986] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:43.499563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.585838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:43.601515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1ee87-f2c6-4830-95c3-c2e29dbc10ef None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.636280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.636908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.637188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.637460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.644698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.646127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:43.657066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:43.657982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:43.658929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 494/987] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:43.665365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.769748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8168-e2c4-4113-8115-4e65cc6d409f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.805582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.806222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.806724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.806831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.807451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:43.807810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.809172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2810488-e09f-4321-8294-e865214f7476 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.823018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 494/988] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:43.828342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:43.931886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45b70e-7ccb-43c2-9f67-543f8380cd53 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:43.966661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:43.967259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:43.967541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:43.967815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:43.968537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] RBAC: Adding query filter params (role.id=a9d9e6298f1844018b2c971078a7bbf5, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=21f021f13320436c95800de92d844fd7) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:43.968843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:43.970254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7bb03-b16c-4733-a205-52ab66d43b4d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:43.982549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 495/989] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:43 2022] GET /identity/v3/role_assignments?user.id=21f021f13320436c95800de92d844fd7&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=a9d9e6298f1844018b2c971078a7bbf5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:44.764794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9ab4-dccd-47c7-884f-141cbe7ff581 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:44.765305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9ab4-dccd-47c7-884f-141cbe7ff581 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:44.765305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9ab4-dccd-47c7-884f-141cbe7ff581 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:44.770570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 495/990] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:44.772484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3b12-4a02-42f5-b69d-59226bd1bcd9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:44.772774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3b12-4a02-42f5-b69d-59226bd1bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:44.773046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a3b12-4a02-42f5-b69d-59226bd1bcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:44.791487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6a9a3b12-4a02-42f5-b69d-59226bd1bcd9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:44.792995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6a9a3b12-4a02-42f5-b69d-59226bd1bcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:44.794966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:44.860554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:45.087238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a4fb-964a-4804-83d1-964043b9ee0a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.087611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a4fb-964a-4804-83d1-964043b9ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.087789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a4fb-964a-4804-83d1-964043b9ee0a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.089313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 496/992] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:45.094882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.095191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.095437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.114768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:45.115943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:45.129661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a4fb-964a-4804-83d1-964043b9ee0a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.186569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:45.188245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.238404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a4fb-964a-4804-83d1-964043b9ee0a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.271572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.272195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.272475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.272748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.273328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.274714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:45.283250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:45.284287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:45.285787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:45.287183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 497/994] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:45.290848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.358604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.390758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f117d3e-3f75-4fad-8640-62d231e5eda5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.424205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.424807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.425170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.425371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.425993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:45.426290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.427670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.436983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 498/995] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:45.438103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.453890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.546997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34c9d0-df54-4b70-9bfa-42327096c168 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.561987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319c6a0-2980-4ef7-b452-6985dce83c27 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.562562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.586209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.587055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.587666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.587953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.588864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:45.589170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.591329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.593165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.598238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 498/996] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:45.603353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.604577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.604678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.604678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.604678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.605088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.606418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:45.615842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:45.617027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:45.617909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 499/997] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:45.622389 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.713956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60508-f4cf-4a3e-ba0c-71f001e4608b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.725297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c3518-0daf-45d2-a261-eafb993d36d6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.748889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.749498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.749780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.750053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.750789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] RBAC: Adding query filter params (interface=public, service_id=d76d3edf66e54afc9b4d9dc3bafa6060, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:45.751100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.752484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.758488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 499/998] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/endpoints?service_id=d76d3edf66e54afc9b4d9dc3bafa6060&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:45.763917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.767115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.767722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.767999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.768270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.769504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:45.769803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.771196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.780838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 500/999] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:45.781507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.807227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.842421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:45.867036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8014d-16f9-4dbb-bf71-53197b495b1a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.887264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5843d-a512-4d51-961f-5b52235d24e2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:45.903712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.904319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.904599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.904866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.905467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.906851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dcdf3-dcd0-4652-b4a3-809462329a8f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.913031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 500/1000] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:45:45.924599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:45.925527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.925955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.926374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.927216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:45.927786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:45.928939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676c50-497d-4a19-adc7-15071434b7dd None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.929225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676c50-497d-4a19-adc7-15071434b7dd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.929497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97676c50-497d-4a19-adc7-15071434b7dd None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.929882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:45.930907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 501/1001] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:45.936348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 501/1002] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Aug 12 11:45:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:45.936741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:45.937095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:45.937377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:45.942644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:45.957317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:45.958565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:46.035442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 502/1003] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:46.061940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5677fb-2a33-4582-b589-d0ac27fd1d66 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:46.087342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:46.098595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:46.099192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:46.099465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:46.099730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:46.100377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:46.101720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:46.171979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 502/1004] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:46.310184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:46.346583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:46.413157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ad4b-0bf9-4aad-9a1d-e5a6d412b45f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:46.453314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:46.453893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:46.454169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:46.454436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] PATH_INFO: `/v3/services/image` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:46.455045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:46.457008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:46.465775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:46.467052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:46.467923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:46.471752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 503/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Aug 12 11:45:46 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:46.475646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:46.577804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036994c-7702-46dd-af75-9e8738c94e4e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:46.612612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:46.613396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:46.613772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:46.614145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:46.614924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] RBAC: Adding query filter params (name=image) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:46.615329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:46.616787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30c7a1-be34-42fb-8ee7-53192732d629 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:46.626239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 503/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:46.627435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:46.727432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:46.736192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee951b4a-e108-41eb-ac5e-8816c96b459f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:46.771944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:46.772631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:46.772978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:46.773315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:46.774007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] RBAC: Adding query filter params (type=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:46.774374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:46.775819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0c037-2c3a-4373-b7f0-442d918e4116 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:46.786613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 504/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:47.870247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d13a2-a147-45d1-80df-dd8d1dbef6d3 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:47.870873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d13a2-a147-45d1-80df-dd8d1dbef6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:47.870873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d13a2-a147-45d1-80df-dd8d1dbef6d3 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:47.872303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 504/1008] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:47.877249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5aa1-c028-4e89-b700-026167da4cdf None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:47.877629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5aa1-c028-4e89-b700-026167da4cdf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:47.877807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5aa1-c028-4e89-b700-026167da4cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:47.896741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-791c5aa1-c028-4e89-b700-026167da4cdf None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:47.897915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-791c5aa1-c028-4e89-b700-026167da4cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:47.965290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 505/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:48.091094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683ba4-5bb5-416d-b3c8-b123de4514fa None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.091429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683ba4-5bb5-416d-b3c8-b123de4514fa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.091639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8683ba4-5bb5-416d-b3c8-b123de4514fa None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.093131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 505/1010] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:48.098009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.098295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.098594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.116445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:48.117627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:48.183526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 506/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:48.233859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8683ba4-5bb5-416d-b3c8-b123de4514fa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.286036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:48.338608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8683ba4-5bb5-416d-b3c8-b123de4514fa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.372037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.372926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.373230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.373671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.374286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.376245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:48.385599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:48.390738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:48.391600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 506/1012] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:48.393137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.414372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:48.458108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.501803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796059f-86b0-4381-b4bb-b7d161e1a8c7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.537577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.538187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.538468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.538782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.539417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:48.539725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.541078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.546040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 507/1013] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:48.551966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.572768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56547-5e5d-449c-8d3e-e71ac961a412 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.588488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:48.612986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.614203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.614738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.615216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.616378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.618121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.620560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 507/1014] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:48.625955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.645647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:48.661912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156c3c-a938-40ac-baf6-9c033def8aa6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.699282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.699894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.700177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.700442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.701106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] RBAC: Adding query filter params (type=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:48.701408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.702809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195d720-dc02-46bd-a140-b81b9af4eced None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.707750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 508/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Aug 12 11:45:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:48.708960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3eda-01d9-4721-bd0d-e1c4b61c4121 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.709183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3eda-01d9-4721-bd0d-e1c4b61c4121 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.709456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3eda-01d9-4721-bd0d-e1c4b61c4121 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.710654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 509/1016] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:48.713235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3eda-01d9-4721-bd0d-e1c4b61c4121 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:48.738871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c97bd-af79-42ae-95c8-0aa745540394 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.771425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.772024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.772302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.772572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.773204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.774643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18e9ce-c20f-40f5-8015-70643a00dc51 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.811234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3eda-01d9-4721-bd0d-e1c4b61c4121 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:48.843480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:48.844073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.844353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.844625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.845274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:48.847281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:48.892033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 508/1017] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:48 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:48.893264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adf5-7ad8-4869-9928-9f7967d94eb9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:48.893549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adf5-7ad8-4869-9928-9f7967d94eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:48.893814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243adf5-7ad8-4869-9928-9f7967d94eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:48.914883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d243adf5-7ad8-4869-9928-9f7967d94eb9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:48.916114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d243adf5-7ad8-4869-9928-9f7967d94eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:48.944853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:48.955329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 510/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:49.005864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 509/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:48 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:49.272313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:49.276399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:49.373108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27446dd-5b4d-4528-9982-74b3be1969b6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:49.412294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:49.412910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:49.413189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:49.413462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:49.414119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:49.415504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0977bd-3b11-4c78-9ad2-8c92a731dfae None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:49.516852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 511/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:45:49 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:45:50.864329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29797c7-29eb-4647-88d5-d564e0385d5f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:50.864846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29797c7-29eb-4647-88d5-d564e0385d5f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:50.864846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29797c7-29eb-4647-88d5-d564e0385d5f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:50.866185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 510/1021] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:50.871554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a85-c6f8-4c26-89ca-855d6654d51d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:50.872286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a85-c6f8-4c26-89ca-855d6654d51d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:50.872703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a85-c6f8-4c26-89ca-855d6654d51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:50.891367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0d167a85-c6f8-4c26-89ca-855d6654d51d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:50.892731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0d167a85-c6f8-4c26-89ca-855d6654d51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:50.950331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:50.965401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:50.993703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa436-3c7c-4790-8a4a-d34371189f49 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:50.993978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa436-3c7c-4790-8a4a-d34371189f49 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:50.994263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa436-3c7c-4790-8a4a-d34371189f49 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:50.995633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 511/1023] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:51.000876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.001165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.001443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.021179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:51.022359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:51.097019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 513/1024] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:51.232785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa436-3c7c-4790-8a4a-d34371189f49 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.335735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa436-3c7c-4790-8a4a-d34371189f49 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:51.364438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.369441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:51.370070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.370347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.370644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.371737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:51.373159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:51.374892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 512/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:51.380853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.413818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:51.475128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30533875-74ff-403f-86a1-6b75fdcce0b0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:51.491787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad9ab0-2c35-4950-b363-8345d0363e36 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:51.495081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:51.509433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:51.510060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.510339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.510646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.520685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:51.525882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-85fba8d1-9b2b-4bc2-a0f6-2c5f292d83f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:51.526200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:51.527198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:51.531630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:51.532291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.532291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.532291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.532291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:51.532535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 514/1026] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:45:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:51.532535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebee-0d5b-4ac6-839a-3e18c5c4e199 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.532682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5488b-d848-40af-944c-41ab85edac62 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:51.532753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebee-0d5b-4ac6-839a-3e18c5c4e199 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.532753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ebee-0d5b-4ac6-839a-3e18c5c4e199 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.532753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 515/1027] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:51.533503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ebee-0d5b-4ac6-839a-3e18c5c4e199 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.619013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 513/1028] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:45:51 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:51.620282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.620601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.620872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.641792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ebee-0d5b-4ac6-839a-3e18c5c4e199 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:51.646983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:51.648220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:51.681933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:51.682603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.682881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.683166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.683831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:51.684132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:51.685582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:51.698728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 516/1029] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:45:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:51.703653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.746630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 514/1030] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:51.768823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:51.827171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fcf17-4e17-47b1-89d3-7f1b9799621d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:51.863683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:51.864313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:51.864600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:51.864874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:51.875853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:51.877299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:51.891754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:51.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:51.893685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:51.893685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:51.893685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:51.893685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 517/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:51.900258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:51.915495 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.001063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885db62-bc4b-41a3-8998-5f8ea8603f29 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.007800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.045716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.046332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.046642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.046916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.047566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:52.047875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.049244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.069074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 515/1032] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:52.070156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.116480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.123321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53121c82-df4e-4c99-89ce-f9762a9d07d8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.147136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.161396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.162028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.162305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.162608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] PATH_INFO: `/v3/services/image` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.163194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.164549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:52.174142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:52.175623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:52.176520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 518/1033] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:52.180339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c69a8-14d8-4510-a84d-52abc38e5a67 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.181128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.215753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.216386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.216665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.216935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.225054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.226490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:52.237508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:52.238469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:52.239473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 516/1034] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:52.244222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.287355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584dcdf-5024-4f58-afa4-c2ecc5d6e276 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.324752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.325646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.325942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.326286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.326991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] RBAC: Adding query filter params (name=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:52.327297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.328671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.343159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 519/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:52.344534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.365822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3a7b1-c9d3-4cc9-bcf1-9c7ee852401d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.373661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.399752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.405058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.405665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.405944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.406215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.407055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:52.407368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.408859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.427158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 517/1036] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:52.432835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.458624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382b2be-ccd8-4de2-a4a0-3cdf9729b681 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.500232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.501096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.501563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.502010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.503393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:52.503886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.505732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.512902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 520/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:52.519065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.544789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7b83-6cb1-4b68-a82f-de4ec23bdb04 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.579649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.580282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.580561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.581401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.609767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.624594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49859f7-d342-4899-9793-e9a28f15f0d2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.642507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.652874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.654344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.665539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.666144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.666419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.666723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.667422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] RBAC: Adding query filter params (interface=public, service_id=6ebf681851e8401ba8e5076a3b597263, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:52.667725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.669067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.674805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 521/1038] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/endpoints?service_id=6ebf681851e8401ba8e5076a3b597263&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:52.680205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.762362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 518/1039] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:52.767813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.781370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ceba2-d4a8-49bb-903b-8be180713996 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.818021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.818706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.818995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.819266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.820253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.821765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.828129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 522/1040] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:45:52.881205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:52.891706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc49b-d507-40ee-8cfb-e601968af806 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:52.927659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:52.928343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:52.928591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:52.928836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:52.940117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:52.942095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:52.957578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:52.958674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:52.959707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:52.959707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:52.959707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:52.959707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 519/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:52.964608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:52.983672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:53.068688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff060-65f3-4467-a171-16e4c0be1a71 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:53.102021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:53.102657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.102935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.103206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.103837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:53.104132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:53.105474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:53.117347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 523/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:53.123304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:53.224898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fccf5b-a9b1-4fcf-9401-ef9fb854907b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:53.259122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:53.259754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.260041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.260301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.267176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:53.268640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:53.279748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:53.282105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:53.283100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 520/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:53.287277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:53.363220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:53.387695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1a78-519c-4729-9daa-f9aeff2b1276 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:53.420901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:53.421505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.421783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.422053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.422769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:53.423074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:53.425107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1a9ea-2f19-431c-8a4e-a753a3931815 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:53.438595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 524/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:53.443134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:53.445989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:53.549062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4b84-e29d-4b45-9074-891f9164bba5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:53.583143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:53.583745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.584023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.584294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.585037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] RBAC: Adding query filter params (role.id=a9d9e6298f1844018b2c971078a7bbf5, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:53.585342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:53.586796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844fbf2-eb94-4b40-b9c7-48278994350f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:53.592456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 521/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:53 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=a9d9e6298f1844018b2c971078a7bbf5 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:53.622739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e959-3e3e-4a23-b9db-f6aa1a603150 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.622932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e959-3e3e-4a23-b9db-f6aa1a603150 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.623210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e959-3e3e-4a23-b9db-f6aa1a603150 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.624801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 525/1046] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:53.630320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:53.630648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:53.630925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:53.651119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:53.652365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:53.718343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:53.727743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 522/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:53.997543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e959-3e3e-4a23-b9db-f6aa1a603150 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:54.101646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e959-3e3e-4a23-b9db-f6aa1a603150 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:54.135762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:54.136386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.136664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.136948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.138808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:54.148293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:54.152898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:54.153813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:54.155469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 526/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:54.161592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:54.261044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f064-7e94-4d43-bb4e-a5d5fed7ce80 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:54.293956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:54.294590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.294870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.295143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.295807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:54.296110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:54.297479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:54.311058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 523/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:54.312401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:54.418168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8c62b-84aa-4e9e-bd02-cf09e6058308 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:54.456726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:54.457365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.457637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.457904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] PATH_INFO: `/v3/users/1ba911b3a1b54bb59207194d7bf7044a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.471495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba911b3a1b54bb59207194d7bf7044a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:54.472929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4910d-8a0f-491d-9e3b-d3b47507b4e5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:54.479326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 527/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:45:54 2022] GET /identity/v3/users/1ba911b3a1b54bb59207194d7bf7044a => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:54.480538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:54.542471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:54.584759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d4351-f738-4340-a941-aa9092f470a7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:54.618454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:54.619085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.619363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.619630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.688302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:54.689750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:54.735084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615c15-e2a1-4dbd-8e24-ddcbdd5a0e01 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.735464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615c15-e2a1-4dbd-8e24-ddcbdd5a0e01 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.735653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615c15-e2a1-4dbd-8e24-ddcbdd5a0e01 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.737797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 528/1051] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:54.743334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.743539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.743771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.746986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:54.761859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:54.763052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:54.791751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 524/1052] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:45:54.797206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:54.817021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:54.836215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 529/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:45:54.898333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937717-017b-45a0-aaef-fcc50d9bf6b7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:54.934148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:54.935139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:54.935726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:54.936199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:54.937564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:54.939306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:54.941169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 525/1054] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:45:54 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:54.947232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.045740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5a72-a8b6-4453-9069-9bf84964dd18 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:55.078900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:55.079428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.079705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.079977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.081223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=c510996326a0469b89879c3fddf8691c, user.id=1ba911b3a1b54bb59207194d7bf7044a) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:55.081526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:55.082972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:55.094624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 530/1055] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:45:54 2022] GET /identity/v3/role_assignments?user.id=1ba911b3a1b54bb59207194d7bf7044a&scope.project.id=c510996326a0469b89879c3fddf8691c&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:55.111901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.141715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:55.220512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be066e71-1b03-4905-a9db-b9bb646a9d98 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:55.255669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:55.256300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.256843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.257114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] PATH_INFO: `/v3/services/image` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.257698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:55.259162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:55.267728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:55.269248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:55.270098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 526/1056] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Aug 12 11:45:55 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:55.275403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.322141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:55.375532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba5a10-dee6-4429-88f2-d7e4afafd03c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:55.409139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:55.409738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.410015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.410284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.410934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:55.411232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:55.412590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07dcc6-d217-436d-92d5-d396d1c9c7c5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:55.417647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 531/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:55.423092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.523162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa512a-199c-44ae-a4c7-566d16f4412f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.523527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa512a-199c-44ae-a4c7-566d16f4412f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.523820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa512a-199c-44ae-a4c7-566d16f4412f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.525699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 532/1058] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:55.525811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:55.530205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.530492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.530792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.535871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb7f4b-86ed-4bc3-8212-d6ea202042bc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:55.548627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:55.549819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:55.573516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:55.574372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.574827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.575475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.576106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] RBAC: Adding query filter params (type=image) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:55.576511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:55.577869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:55.585407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 527/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:55.590145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.624324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 533/1060] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:55.689310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a089ab-f64a-4ed9-bbc8-4e30460b1a51 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:55.724073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:55.724676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:55.724951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:55.725217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:55.725864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:55.727228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:55.818545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 528/1061] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:45:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:45:55.896057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:55.942125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.006870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae9ac2-2dea-4f05-839e-ca02c97d16fc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.046851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.047487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.047759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.048026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.058509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:56.063211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:56.064168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:45:56.065611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:56.069902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 534/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:45:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:56.071278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.084409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.176154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036024-b5fa-4301-86b8-1fb595904e3a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.208861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.209389 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.209665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.209935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.210622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:56.210925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:56.212280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:56.225182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 529/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:56.227185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.321714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.327983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0301c9-9d4f-4fb7-afdc-dc5550adc071 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.368384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.369011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.369289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.369563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.379549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:56.380978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:56.395530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:56.396530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:56.402306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:56.402306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:56.402306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:56.402306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 535/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:56.404192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.484529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.515358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148799-62fe-4cd2-b083-f796572a8baf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.549113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.549715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.549993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.550264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.550928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:56.551233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:56.552584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:56.568757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 530/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:56.570395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.671544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e329aa-50e3-46a9-9825-3d3ef6101e1f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.703243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.703860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.704136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.704403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.712506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:56.713932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:45:56.730470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:56.732644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:56.736474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 536/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:56.737827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.841966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7396c0-6bff-416e-a12b-6928901afb96 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:56.871928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.877860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:56.878544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.878845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.879116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.879842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:56.880141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:56.881810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe558d-5c1c-48e6-a8b6-4c8acfced09e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:56.904573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 531/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:56.905840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:56.917735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:56.987115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535030-ab25-4326-9a61-b876cfb71d65 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.987402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535030-ab25-4326-9a61-b876cfb71d65 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.987740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39535030-ab25-4326-9a61-b876cfb71d65 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:56.989266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 532/1068] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:45:56.993885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:56.994165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:56.994432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.010041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336379a-d4cb-44a7-bf27-be30d868d8ab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.012494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:57.013653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:57.048216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.049447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.049868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.050317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.065209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.066701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:57.084220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:57.085189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:57.086086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:57.086086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:57.086086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:57.086086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 537/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:57.091048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.096948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 533/1070] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:57.149145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:57.189283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac492b-d517-411a-9101-8cd42930426b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.223084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.223683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.223962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.224235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.224870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:57.225170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.226535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.242640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 538/1071] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:57.244901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.344658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f79fc2-1749-460e-83da-0df4d5b628cb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.364078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.373157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:57.389506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.390877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.391344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.391813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.401063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.403365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:45:57.417683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:57.418712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:45:57.419619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:57.422669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 534/1072] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:57.426566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.476762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbd5d9-cd58-475e-974a-c92f4de29448 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.497952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:57.511935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.512555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.512831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.513099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.523239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:45:57.528316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:57.529301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:45:57.530148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:45:57.534755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 539/1073] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:45:57.535438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.540477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8a9a-6f59-48ce-9e69-3b84eab76ae4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.575801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.576406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.576691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.576962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.577664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:57.577973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.579433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.591635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 535/1074] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:57.598268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.639044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b4a35-7352-493c-b3f0-ef9050c5eff2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.650380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:57.680583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.681466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.681773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.682020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.682712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:57.683017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.684375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.693101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 540/1075] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:57.698628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.710726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c40e5-7233-4000-ae92-8f334c99bdf5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.747735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.748463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.748666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.748937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/a9d9e6298f1844018b2c971078a7bbf5` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.750697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:57.751106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=6d46631580f04d5b8eb42424d520f83c, role_id=a9d9e6298f1844018b2c971078a7bbf5)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.752560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae184aa-6379-405a-9b33-a886da9e1d9f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.806851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400692d1-66a7-4944-b03e-692ea0e1121f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.823726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 536/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:57 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/6d46631580f04d5b8eb42424d520f83c/roles/a9d9e6298f1844018b2c971078a7bbf5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:45:57.824944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe70f-36e8-4644-92af-8d1c9518b8b1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.825227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe70f-36e8-4644-92af-8d1c9518b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.825506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fe70f-36e8-4644-92af-8d1c9518b8b1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.827030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 537/1077] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:57.832519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.832835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.833274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.845583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:57.848710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:57.848710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:57.848710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] PATH_INFO: `/v3/users/1ba911b3a1b54bb59207194d7bf7044a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:57.848710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] RBAC: Authorizing `identity:get_user(user_id=1ba911b3a1b54bb59207194d7bf7044a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:57.850034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:57.851933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 541/1078] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/users/1ba911b3a1b54bb59207194d7bf7044a => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:45:57.853711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:57.855201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:57.857685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:57.939155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 538/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:45:57.971822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebe6a0-7eaa-4957-b0ee-8c0ac1b1ffca None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:57.983618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:58.007548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:58.008108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:58.008388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:58.008663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:58.009833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:58.011332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:58.013105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 542/1080] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:45:57 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:58.019312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:58.050411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:58.120351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d0b27-fbf0-4009-8de6-503659c489ad None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:58.155234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:58.155893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:58.156172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:58.156443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c/users/1ba911b3a1b54bb59207194d7bf7044a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:58.158363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] RBAC: Authorizing `identity:create_grant(project_id=c510996326a0469b89879c3fddf8691c, user_id=1ba911b3a1b54bb59207194d7bf7044a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:58.160386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:58.216968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:58.229116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 539/1081] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:45:58 2022] PUT /identity/v3/projects/c510996326a0469b89879c3fddf8691c/users/1ba911b3a1b54bb59207194d7bf7044a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:45:58.330441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7227a-b33c-44cc-b442-b2046c42df83 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:58.373746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:58.374362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:58.374671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:58.374944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:58.422902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:58.444437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:58.446114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:58.552851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 543/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:45:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:45:58.558400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:58.653088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:58.663092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e456-f69d-42a8-936e-f9eeac939160 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:58.699959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:58.700627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:58.700906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:58.701224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:58.711323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:58.712774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-65aebf4e-1280-4a51-9031-a71885934021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:45:58.728570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:45:58.729559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:45:58.734918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:45:58.734918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:45:58.734918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:45:58.734918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 540/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:45:58.737691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:45:58.815187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:45:58.837171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffef53b-f899-4ee2-ac16-4fde804fcb7b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:45:58.871933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:45:58.872538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:58.872817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:58.873096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:58.873737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:45:58.874036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:45:58.875414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c8b3e-743b-4fd1-bfd1-0312dcc726d6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:45:58.894566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 544/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:45:59.749658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74a21a-974b-4d3f-af9e-826650c755b7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:59.750161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74a21a-974b-4d3f-af9e-826650c755b7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:59.750161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74a21a-974b-4d3f-af9e-826650c755b7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:59.751487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 541/1085] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:45:59.758542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fd13-64fb-4034-b1ac-702be696fca7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:45:59.759034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fd13-64fb-4034-b1ac-702be696fca7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:45:59.759141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fd13-64fb-4034-b1ac-702be696fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:45:59.776471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-44e2fd13-64fb-4034-b1ac-702be696fca7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:45:59.777658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-44e2fd13-64fb-4034-b1ac-702be696fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:45:59.841350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 545/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:00.107838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74a21a-974b-4d3f-af9e-826650c755b7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.143970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c847685-dcb9-4b9a-b6e2-19aaa3afc363 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.144261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c847685-dcb9-4b9a-b6e2-19aaa3afc363 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.144541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c847685-dcb9-4b9a-b6e2-19aaa3afc363 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.145864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 546/1087] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:46:00.150780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.151066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.151344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.169577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:00.170800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:00.208660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74a21a-974b-4d3f-af9e-826650c755b7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.230840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.238558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 547/1088] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 11:46:00.243594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.244217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.244498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.244772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.254660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:00.259548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:00.260648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:00.261510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 542/1089] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:00.266676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.362545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737647c-c27e-4e04-8a0f-93c9a4f81dc8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.399233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.399834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.400111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.400379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.401031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:00.401330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.402708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.415643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 548/1090] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:00.416816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.420184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.502381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.514714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a69-7af6-4e9e-afa8-df9213fffc5b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.548355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.548978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.549254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.549517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.559163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.560629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.561223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:46:00.575874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:00.577038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:46:00.577959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:46:00.577959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:46:00.577959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:00.577959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 543/1091] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:00.583282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.602228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b058b9-722d-448e-83ca-9c0de6440d28 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.636850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.637402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.637672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.637943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.639983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.648368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:00.653493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:00.654476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:46:00.655411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 549/1092] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:46:00.660513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.685241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78c1dc-418b-42fe-adc5-8fef69b92ec2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.719272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.719869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.720144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.720406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.721088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:00.721382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.722779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.734292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 544/1093] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:00.739881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.759227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc270e1-f817-475a-99b4-28870f4503b1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.779249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.793431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.794037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.794317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.794626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.795283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:00.795589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.796945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.805722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 550/1094] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:00.811112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.840153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b33a3-5ce5-4631-b77d-cc065ccec81b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.854425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:00.873689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.874306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.874608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.874878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.882668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.884331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:46:00.896669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:00.897793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:00.899010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 545/1095] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:46:00.903275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.910549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49bfa4-3644-4e3b-b82b-d329e025d437 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:00.944477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:00.945097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:00.945376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:00.945645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] PATH_INFO: `/v3/users/1ba911b3a1b54bb59207194d7bf7044a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:00.946815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] RBAC: Authorizing `identity:get_user(user_id=1ba911b3a1b54bb59207194d7bf7044a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:00.948250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:00.949831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 551/1096] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/users/1ba911b3a1b54bb59207194d7bf7044a => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:00.956105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:00.999834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd2b5-2620-4bc9-8851-312a51562df9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.003969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.032700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.033319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.033598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.033864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.034616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:01.034917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.036324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.052431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7bdd7-02d4-4254-ae39-96073a87b53a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.053441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 546/1097] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:01.059061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.086502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.087151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.087428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.087700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.089200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.155081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.156433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.157670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd472d6-0a99-4899-9652-c8010085be7f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.191735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.192335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.192613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.192884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.203240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.253306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 552/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:46:01.259355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.263005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.264446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.293604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.357190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125b92-6b18-436f-8c02-7dfdd2464cf8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.362411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 547/1099] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:46:01.368063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.392323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.392962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.393237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.393509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.394628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.396020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.397601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 553/1100] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:01.403503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.422565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.464243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f60e9-b7f0-4ac0-989b-21b678ae405b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.493345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.498603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.499232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.501518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.501518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.504533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e64-c8de-4c2c-b608-077fc92de4e2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.509666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.511137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:46:01.525715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:01.526747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:46:01.532359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:46:01.532359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:46:01.532359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:01.532359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 548/1101] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:46:01.532359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.538187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.538808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.539083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.539349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.540058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=c510996326a0469b89879c3fddf8691c, user.id=1ba911b3a1b54bb59207194d7bf7044a) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:01.540359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.541758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.554731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 554/1102] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/role_assignments?user.id=1ba911b3a1b54bb59207194d7bf7044a&scope.project.id=c510996326a0469b89879c3fddf8691c&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:01.636245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde4f02-5cc4-4f9f-9c5a-429dd84ff299 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.671274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.671887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.672181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.672427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.679559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:01.679559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.679559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.688850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 549/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:01.695233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.779241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.797434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848e40a-d7e3-41bd-b1f6-b762d6c3bb80 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.830651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.831269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.831542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.831809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.838216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.839660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:46:01.850956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:01.852003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:46:01.852924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 555/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:01.857877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:01.903227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:01.956583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3ffc-9db4-401b-b3d6-23c2a13d2628 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:01.989004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:01.989607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:01.989881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:01.990146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:01.990861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:01.991163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:01.992570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e12663-f2ea-4e50-a4e3-8d1b391247c6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:02.004239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 550/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:02.010634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:02.113542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a082cb-6a4b-4b9a-9d36-aa69889a5ca4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:02.146400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:02.147031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:02.147308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:02.147576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:02.148287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] RBAC: Adding query filter params (role.id=a9d9e6298f1844018b2c971078a7bbf5, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=6d46631580f04d5b8eb42424d520f83c) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:02.148588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:02.149984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cc144-df86-46e0-b5ee-57c892386b53 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:02.155790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 556/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:02 2022] GET /identity/v3/role_assignments?user.id=6d46631580f04d5b8eb42424d520f83c&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=a9d9e6298f1844018b2c971078a7bbf5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:03.532296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaf11-5a23-4851-a070-3362c598f5fb None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:03.532795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaf11-5a23-4851-a070-3362c598f5fb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:03.532891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9aaf11-5a23-4851-a070-3362c598f5fb None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:03.534775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 551/1107] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:03.539950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:03.540356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:03.540501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:03.553156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:03.558351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:03.559582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:03.624323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 557/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:03.887704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aaf11-5a23-4851-a070-3362c598f5fb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:03.984243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9aaf11-5a23-4851-a070-3362c598f5fb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:03.987078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:04.018029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:04.018677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:04.018958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:04.019226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:04.020335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:04.021749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851746a-d5d1-4d55-bf1a-d5cbf6faf1d0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:04.023333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 552/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:46:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:04.028993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:04.122352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d6d89-daed-4c9a-8565-85c848b1ebee None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:04.154904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:04.155432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:04.155710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:04.155977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:04.156594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:04.158013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfcbd1-ebda-42a9-adb7-5c484856775a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:04.166604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:04.272046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 558/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:46:04 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:06.189170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d861b-482e-4f59-9dc9-39bed1f187c0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:06.189743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d861b-482e-4f59-9dc9-39bed1f187c0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:06.189743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d861b-482e-4f59-9dc9-39bed1f187c0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:06.191105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 553/1111] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:06.196864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:06.197347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:06.197441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:06.218379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:06.219595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:06.285161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 559/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:06.560711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d861b-482e-4f59-9dc9-39bed1f187c0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:06.658926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d861b-482e-4f59-9dc9-39bed1f187c0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:06.691797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:06.692406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:06.692683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:06.692955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] PATH_INFO: `/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:06.694320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] RBAC: Authorizing `identity:get_role(role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:06.695698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:06.696994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 554/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:06 2022] GET /identity/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:06.702839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:06.798780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a00caf-6cac-46bf-b5f2-e3e52eb18903 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:06.827748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:06.839629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:06.840262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:06.842576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:06.842576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] PATH_INFO: `/v3/users/841b0eb7da734b7991076376d8d7a671` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:06.856481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] RBAC: Authorizing `identity:get_user(user_id=841b0eb7da734b7991076376d8d7a671)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:06.857915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:06.859554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 560/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:06 2022] GET /identity/v3/users/841b0eb7da734b7991076376d8d7a671 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:06.865533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:06.907011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:06.961449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1891991-f8a4-4550-9a5d-750fe63cc99a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:06.993380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:06.993949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:06.994224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:06.994491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:07.057793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:07.059186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:07.096523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:07.153052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 555/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:46:07.158970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:07.261797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad576de4-a0ba-46d8-a1ac-819efd67cbe4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:07.296268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:07.296886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:07.297162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:07.297431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:07.299363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:07.301169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da25777-f378-4aec-8a1e-bfa4042b1774 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:07.302561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 561/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:07 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:07.308878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:07.404158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605bf68-06f2-45bc-ab67-da441ee71d96 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:07.437180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:07.437778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:07.438054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:07.438323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:07.439095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=c510996326a0469b89879c3fddf8691c, user.id=841b0eb7da734b7991076376d8d7a671) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:07.439400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:07.440814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4618e4-7fab-4d37-955e-179f7303c1f0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:07.445961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 556/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:07 2022] GET /identity/v3/role_assignments?user.id=841b0eb7da734b7991076376d8d7a671&scope.project.id=c510996326a0469b89879c3fddf8691c&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:09.305716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013251-b75d-484d-8751-ac570d785ce0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:09.306249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013251-b75d-484d-8751-ac570d785ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:09.306249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8013251-b75d-484d-8751-ac570d785ce0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:09.307581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 562/1118] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:09.312571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:09.312988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:09.313098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:09.320770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:09.331041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:09.332203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:09.396614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 557/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:09.674662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8013251-b75d-484d-8751-ac570d785ce0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:09.724418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:09.772794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8013251-b75d-484d-8751-ac570d785ce0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:09.804687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:09.805291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:09.805563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:09.805831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] PATH_INFO: `/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:09.807206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] RBAC: Authorizing `identity:get_role(role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:09.808541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:09.809808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 563/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:09 2022] GET /identity/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:09.815547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:09.908532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab411d1-ce49-4090-b30f-fed36b2c4a73 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:09.941154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:09.941700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:09.941973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:09.942242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] PATH_INFO: `/v3/users/841b0eb7da734b7991076376d8d7a671` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:09.943362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] RBAC: Authorizing `identity:get_user(user_id=841b0eb7da734b7991076376d8d7a671)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:09.944768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:09.946305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 558/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:09 2022] GET /identity/v3/users/841b0eb7da734b7991076376d8d7a671 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:09.952021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:10.046757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141bc36-87e6-43df-ae15-f5c88397ba21 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:10.061556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:10.077917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:10.078532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.078816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.079084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.080689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:10.082083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d63cf-c47c-4e04-ab1b-4ca92b8a0ead None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:10.083674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 564/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:09 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:10.089478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:10.092288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:10.185009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f0c0-8342-47eb-8791-c61a67bfdae0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:10.216521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:10.217095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:10.217370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:10.217636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c/users/841b0eb7da734b7991076376d8d7a671/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:10.219746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] RBAC: Authorizing `identity:create_grant(project_id=c510996326a0469b89879c3fddf8691c, user_id=841b0eb7da734b7991076376d8d7a671, role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:10.221710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc8e34-b8b4-4ae6-b6f4-6deec856e441 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:10.314041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 559/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:46:10 2022] PUT /identity/v3/projects/c510996326a0469b89879c3fddf8691c/users/841b0eb7da734b7991076376d8d7a671/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:46:12.161802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af785915-2c8f-433e-8dfb-4cd68300da16 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.162351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af785915-2c8f-433e-8dfb-4cd68300da16 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.162351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af785915-2c8f-433e-8dfb-4cd68300da16 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.163674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 565/1124] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:12.168918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.169344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.169444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.187478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:12.188644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:12.242998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.252753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:12.525836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af785915-2c8f-433e-8dfb-4cd68300da16 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:12.630172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af785915-2c8f-433e-8dfb-4cd68300da16 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.662934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.663547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.663827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.664099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] PATH_INFO: `/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.665468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] RBAC: Authorizing `identity:get_role(role_id=f1ec826eef8b4b12961cb5b7393ff89b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:12.666836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:12.668128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 566/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:12 2022] GET /identity/v3/roles/f1ec826eef8b4b12961cb5b7393ff89b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:12.674887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:12.769242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c443-f7e6-466f-b253-0b11819acf6e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.803419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.804031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.804309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.804579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] PATH_INFO: `/v3/users/841b0eb7da734b7991076376d8d7a671` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:12.805682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] RBAC: Authorizing `identity:get_user(user_id=841b0eb7da734b7991076376d8d7a671)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:12.807128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:12.808746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 561/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:12 2022] GET /identity/v3/users/841b0eb7da734b7991076376d8d7a671 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:12.814497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:12.865288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:12.914197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb0584-09d7-4a9b-b1a2-3a75be08b375 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:12.946257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:12.946882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:12.947160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:12.947434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:13.012115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:13.013557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:13.061653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:13.107699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 567/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:13.113756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:13.170856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:13.210878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f159f5-d0d2-4ad1-92aa-1bc7bfecafce None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:13.243461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:13.244075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:13.244353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:13.244624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] PATH_INFO: `/v3/projects/c510996326a0469b89879c3fddf8691c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:13.245718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] RBAC: Authorizing `identity:get_project(project_id=c510996326a0469b89879c3fddf8691c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:13.247163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c12b2-d87b-4a44-88e4-f1ca0462ca38 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:13.248761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 562/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:13 2022] GET /identity/v3/projects/c510996326a0469b89879c3fddf8691c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:13.255097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:13.349521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad117c-d0df-4b90-b976-0afc97f00081 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:13.382165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:13.382773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:13.383048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:13.383332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:13.384021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] RBAC: Adding query filter params (role.id=f1ec826eef8b4b12961cb5b7393ff89b, scope.project.id=c510996326a0469b89879c3fddf8691c, user.id=841b0eb7da734b7991076376d8d7a671) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:13.384322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:13.385721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea8fd-3316-4995-8abf-910acbd1d050 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:13.391144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 568/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:13 2022] GET /identity/v3/role_assignments?user.id=841b0eb7da734b7991076376d8d7a671&scope.project.id=c510996326a0469b89879c3fddf8691c&role.id=f1ec826eef8b4b12961cb5b7393ff89b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:15.306970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ace13c-59c0-4369-bea0-54b1443a1de0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:15.307520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ace13c-59c0-4369-bea0-54b1443a1de0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:15.307520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ace13c-59c0-4369-bea0-54b1443a1de0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:15.308875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 563/1131] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:15.314878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:15.315300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:15.315411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:15.332843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:15.334014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:15.344393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:15.398576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 569/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:15.665632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ace13c-59c0-4369-bea0-54b1443a1de0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:15.763306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ace13c-59c0-4369-bea0-54b1443a1de0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:15.789202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:15.796429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:15.802084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:15.802084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:15.802084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:15.802084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:15.802084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdaec7-11a6-47a3-9c17-c7c30c872dc9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:15.802615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 564/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:15.807915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:15.900987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb4ae-f31a-4c05-b251-2800bd8d6158 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:15.933508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:15.934036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:15.934310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:15.934604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:15.935237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:15.936639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c48c11-5831-4238-9400-e51476f2e1ad None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:16.026427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:16.033686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 570/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:46:15 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 11:46:17.947015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb81f-6f9f-499b-9902-8397d609dc08 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:17.947583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb81f-6f9f-499b-9902-8397d609dc08 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:17.947583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb81f-6f9f-499b-9902-8397d609dc08 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:17.948917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 565/1135] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:17.954661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:17.955169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:17.955274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:17.975318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:17.976511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:18.040655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 571/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:18.305059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb81f-6f9f-499b-9902-8397d609dc08 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:18.403708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb81f-6f9f-499b-9902-8397d609dc08 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:18.436406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:18.437076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:18.437353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:18.437620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:18.438756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:18.440173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da7c00-e721-49ff-b53f-86e31d1f9118 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:18.441706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 566/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:18.447455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:18.547878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbab0a-8b35-44c8-b6bf-d4c07cea0e1f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:18.572658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:18.580646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:18.581255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:18.581536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:18.581811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:18.582444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:18.583889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091770d1-7fef-4429-a818-3bdb253340c9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:18.653743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:46:18 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:20.589212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03c88f-689f-4b21-b74a-fc56a7d13119 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:20.589757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03c88f-689f-4b21-b74a-fc56a7d13119 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:20.589757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03c88f-689f-4b21-b74a-fc56a7d13119 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:20.591142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 567/1139] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:20.596401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:20.596788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:20.596946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:20.614792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:20.615957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:20.679493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 573/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:20.943797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03c88f-689f-4b21-b74a-fc56a7d13119 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.004650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:21.043681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03c88f-689f-4b21-b74a-fc56a7d13119 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.076389 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.077027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.077305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.077574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.088244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:21.092790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:21.094502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:21.095626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 568/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:21.100435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.194359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697580a-0b99-4ed4-bb9d-a56f0ccaa8e8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.207461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:21.226851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.227438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.227716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.227987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.228638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:21.228936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:21.230272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:21.238889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 574/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:21.244131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.345648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5dba-f4be-4327-bc82-9fcba5f6bf1d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.367914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:21.378113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.378751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.379029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.379299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] PATH_INFO: `/v3/users/05f60d9d2ca64452b71d32184ead1c7e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.392592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] RBAC: Authorizing `identity:get_user(user_id=05f60d9d2ca64452b71d32184ead1c7e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:21.394017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:21.395628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 569/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:21 2022] GET /identity/v3/users/05f60d9d2ca64452b71d32184ead1c7e => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:21.401562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.497510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0ca88-2073-4f10-ba11-f08d73928e8d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.529533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.530128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.530402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.530705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.572314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:21.595666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:21.597157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:21.691063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 575/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:21.697067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.792430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbe096-7885-44a8-94f0-d4f98c4b6664 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.824709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.825323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.825602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.825874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] PATH_INFO: `/v3/projects/1cc99af8256c4ff09f68628b5e0428ce` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.826999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] RBAC: Authorizing `identity:get_project(project_id=1cc99af8256c4ff09f68628b5e0428ce)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:21.829038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2600b-79da-463d-a143-b2b1cdcc4230 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:21.830663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 570/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:21 2022] GET /identity/v3/projects/1cc99af8256c4ff09f68628b5e0428ce => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:21.836664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:21.908592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:21.930114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e58-8acd-4a6c-8ba0-c8a1eb207904 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:21.966662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:21.967261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:21.967533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:21.967800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:21.968817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=1cc99af8256c4ff09f68628b5e0428ce, user.id=05f60d9d2ca64452b71d32184ead1c7e) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:21.969122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:21.970551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50246-1133-487d-81b6-a27193d6aa99 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:21.976035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 576/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:21 2022] GET /identity/v3/role_assignments?user.id=05f60d9d2ca64452b71d32184ead1c7e&scope.project.id=1cc99af8256c4ff09f68628b5e0428ce&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:23.867261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818fcd-cdcd-4bf3-96a7-6f5afa99f649 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:23.867768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818fcd-cdcd-4bf3-96a7-6f5afa99f649 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:23.867886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818fcd-cdcd-4bf3-96a7-6f5afa99f649 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:23.869191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 571/1147] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:23.874372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:23.874857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:23.874950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:23.892730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:23.893873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:23.957141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 577/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:24.230465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818fcd-cdcd-4bf3-96a7-6f5afa99f649 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:24.280525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:24.329285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818fcd-cdcd-4bf3-96a7-6f5afa99f649 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:24.362344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:24.362976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:24.363250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:24.363516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:24.373259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:24.377792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:24.378925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:24.380123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 572/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:24.385192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:24.451247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:24.481405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f67f8-d557-4816-8f06-56d4af62351f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:24.513946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:24.514554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:24.514830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:24.515096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:24.516299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:24.516598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:24.517927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:24.525584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 578/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:24.532040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:24.628062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8c2b-9bf7-4030-a618-c0f2c049c038 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:24.638155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:24.660615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:24.661228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:24.661506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:24.661775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] PATH_INFO: `/v3/users/05f60d9d2ca64452b71d32184ead1c7e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:24.662906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=05f60d9d2ca64452b71d32184ead1c7e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:24.664311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:24.665857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 573/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:24 2022] GET /identity/v3/users/05f60d9d2ca64452b71d32184ead1c7e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:24.671980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:24.771930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9274-e6c4-4257-ab51-35d94192ab59 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:24.798813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:24.803436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:24.804054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:24.804331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:24.804606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] PATH_INFO: `/v3/projects/1cc99af8256c4ff09f68628b5e0428ce` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:24.805697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=1cc99af8256c4ff09f68628b5e0428ce)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:24.807144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6829cd-0c39-46e5-9b81-eb4fb086c5e7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:24.808732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 579/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:24 2022] GET /identity/v3/projects/1cc99af8256c4ff09f68628b5e0428ce => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:24.815567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:24.911737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827017e-4e0f-4216-9b0a-d77ac1649ec5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:24.949812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:24.950462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:24.950765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:24.951033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] PATH_INFO: `/v3/projects/1cc99af8256c4ff09f68628b5e0428ce/users/05f60d9d2ca64452b71d32184ead1c7e/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:24.953589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=1cc99af8256c4ff09f68628b5e0428ce, user_id=05f60d9d2ca64452b71d32184ead1c7e, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:24.955046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96083f-e0da-4d54-bd0d-bf747ad3e1fc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:25.048949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 574/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:46:24 2022] PUT /identity/v3/projects/1cc99af8256c4ff09f68628b5e0428ce/users/05f60d9d2ca64452b71d32184ead1c7e/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:46:27.010772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af268-4698-45dd-b6e9-9458282be467 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.011297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af268-4698-45dd-b6e9-9458282be467 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.011297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af268-4698-45dd-b6e9-9458282be467 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:27.012640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 580/1154] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:27.017751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.018185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.018280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:27.036281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:27.037438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:27.065752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:27.100977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 575/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:27.365761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af268-4698-45dd-b6e9-9458282be467 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:27.464141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af268-4698-45dd-b6e9-9458282be467 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:27.496646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406936-75d0-4071-959f-164756da0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:27.497259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406936-75d0-4071-959f-164756da0901 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.497536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406936-75d0-4071-959f-164756da0901 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.497808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406936-75d0-4071-959f-164756da0901 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:27.508291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44406936-75d0-4071-959f-164756da0901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-44406936-75d0-4071-959f-164756da0901 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:27.512889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:27.513973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:46:27.515099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 581/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:27.519979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:27.643897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e949d-54d6-47f6-aa79-748ebf17a6dd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:27.676314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:27.676909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.677182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.677448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:27.678100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:27.678396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:27.679772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:27.687460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 576/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:27.693282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406936-75d0-4071-959f-164756da0901 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:27.750321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:27.789817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406936-75d0-4071-959f-164756da0901 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:27.821847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429944d6-c820-40a2-a434-810869553c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:27.822457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429944d6-c820-40a2-a434-810869553c78 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.822766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429944d6-c820-40a2-a434-810869553c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.823042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429944d6-c820-40a2-a434-810869553c78 None admin] PATH_INFO: `/v3/users/05f60d9d2ca64452b71d32184ead1c7e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:27.824154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429944d6-c820-40a2-a434-810869553c78 None admin] RBAC: Authorizing `identity:get_user(user_id=05f60d9d2ca64452b71d32184ead1c7e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:27.825565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429944d6-c820-40a2-a434-810869553c78 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:27.827150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 582/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:27 2022] GET /identity/v3/users/05f60d9d2ca64452b71d32184ead1c7e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:27.832927 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:27.863654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:27.936059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb893-66ae-4bae-987e-41468a3316c8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:27.969993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:27.970625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:27.970909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:27.971185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:28.035994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:28.037430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:28.065744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:28.132181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 577/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:28.138109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429944d6-c820-40a2-a434-810869553c78 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:28.237708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429944d6-c820-40a2-a434-810869553c78 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:28.263001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:28.270408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:28.271057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:28.271334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:28.271604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] PATH_INFO: `/v3/projects/1cc99af8256c4ff09f68628b5e0428ce` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:28.272705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] RBAC: Authorizing `identity:get_project(project_id=1cc99af8256c4ff09f68628b5e0428ce)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:28.274114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae05145-e8a3-456f-ab84-ad05d3ad64fb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:28.275763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 583/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:28 2022] GET /identity/v3/projects/1cc99af8256c4ff09f68628b5e0428ce => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:28.281948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:28.377486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe663-a5c8-4b3f-b117-33921a9034ff None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:28.403852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:28.409815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:28.410403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:28.410704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:28.410973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:28.411680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=1cc99af8256c4ff09f68628b5e0428ce, user.id=05f60d9d2ca64452b71d32184ead1c7e) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:28.411976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:28.417964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3b0b-945a-4848-b898-5146ebf6bb86 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:28.418809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 578/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:28 2022] GET /identity/v3/role_assignments?user.id=05f60d9d2ca64452b71d32184ead1c7e&scope.project.id=1cc99af8256c4ff09f68628b5e0428ce&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:30.293927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347f87-beb2-497f-847d-b28b9a8f1211 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:30.294450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347f87-beb2-497f-847d-b28b9a8f1211 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:30.294596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347f87-beb2-497f-847d-b28b9a8f1211 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:30.295891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 584/1162] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:30.300905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:30.301271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:30.301444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:30.318887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:30.320052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:30.383283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:30.654479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347f87-beb2-497f-847d-b28b9a8f1211 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:30.753157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347f87-beb2-497f-847d-b28b9a8f1211 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:30.788637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:30.789236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:30.789512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:30.789783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:30.847783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:30.853931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:30.855385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:30.951099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 585/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:30.957564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:31.052660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dd00e-c58d-4a5f-aa3e-08d038f68127 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:31.075280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:31.085525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:31.086139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:31.086420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:31.086734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:31.093114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:31.094621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9cc7286e-a681-4bb0-ae0f-2cd5016af9ae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:31.105912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:31.107162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:31.108315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 580/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:46:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:31.113254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:31.203218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:31.208718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863a17-c7b9-4906-bfdc-e7aa7dc7cecf None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:31.241845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:31.242436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:31.242740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:31.243010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:31.243641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:31.243941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:31.245296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bf15c-2030-4424-ba53-476133d92a68 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:31.252797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 586/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Aug 12 11:46:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:33.126480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816440f-bd6f-4f04-8a8b-d354d52b798c None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:33.127036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816440f-bd6f-4f04-8a8b-d354d52b798c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:33.127036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816440f-bd6f-4f04-8a8b-d354d52b798c None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:33.128356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 581/1167] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:33.133624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac1d1-d783-42e9-8f50-9cc467e3d195 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:33.134018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac1d1-d783-42e9-8f50-9cc467e3d195 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:33.134171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac1d1-d783-42e9-8f50-9cc467e3d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:33.152126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-24aac1d1-d783-42e9-8f50-9cc467e3d195 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:33.153301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-24aac1d1-d783-42e9-8f50-9cc467e3d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:33.216296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:33.480789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816440f-bd6f-4f04-8a8b-d354d52b798c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:33.580081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816440f-bd6f-4f04-8a8b-d354d52b798c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:33.613482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:33.614074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:33.614351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:33.614649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:33.615312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:33.616674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60623615-1de6-4986-8bc5-c9cb4de0123a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:33.683842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 582/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Fri Aug 12 11:46:33 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:35.605201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039602c0-3473-4736-8ada-2dfd8f9d24ad None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:35.605715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039602c0-3473-4736-8ada-2dfd8f9d24ad None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:35.605806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039602c0-3473-4736-8ada-2dfd8f9d24ad None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:35.607117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 588/1170] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:35.612980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:35.613363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:35.613520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:35.631870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:35.633062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:35.670975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:35.696505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 583/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:35.963172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039602c0-3473-4736-8ada-2dfd8f9d24ad None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:36.050175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:36.059609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039602c0-3473-4736-8ada-2dfd8f9d24ad None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:36.091025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:36.091634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:36.091908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:36.092176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] PATH_INFO: `/v3/domains/16aebe0d92c34c809af572cf3dde12af` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:36.102448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=16aebe0d92c34c809af572cf3dde12af)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:36.103889 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a96ed4-eabb-40c7-9284-5cf7a27e55e1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:36.105418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 589/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Aug 12 11:46:35 2022] GET /identity/v3/domains/16aebe0d92c34c809af572cf3dde12af => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:36.111780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:36.207080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d5f6a-5342-436d-92ae-98781aa28ece None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:36.239619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:36.240154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:36.240437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:36.240712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:36.241356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:36.242790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d9362-bd84-4224-8723-b915bfdd2bb9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:36.347473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 584/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:46:36 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:38.262426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c93c5-3584-4e61-bbec-125116f87d8a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:38.262988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c93c5-3584-4e61-bbec-125116f87d8a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:38.262988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c93c5-3584-4e61-bbec-125116f87d8a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:38.264323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 590/1174] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:38.269898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:38.270312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:38.270459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:38.293540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:38.294815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:38.315637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:38.364734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 585/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:38.634773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c93c5-3584-4e61-bbec-125116f87d8a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:38.733456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c93c5-3584-4e61-bbec-125116f87d8a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:38.765805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:38.766449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:38.766751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:38.767021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] PATH_INFO: `/v3/domains/16aebe0d92c34c809af572cf3dde12af` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:38.768122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=16aebe0d92c34c809af572cf3dde12af)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:38.769561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4b07e-aa72-4a70-b8bf-34b588fdc745 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:38.771129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 591/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Aug 12 11:46:38 2022] GET /identity/v3/domains/16aebe0d92c34c809af572cf3dde12af => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:38.776946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:38.881328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9de1-6d6f-4312-9908-f837e02563c9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:38.916856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:38.917376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:38.917653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:38.918183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:38.918600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:38.920023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c9d4e-4f90-4529-a1dd-0948d6bbb852 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:39.013944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 586/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:46:38 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:46:40.933017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12326-c4af-4b30-be0e-4b6ffce96c10 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:40.933598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12326-c4af-4b30-be0e-4b6ffce96c10 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:40.933598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12326-c4af-4b30-be0e-4b6ffce96c10 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:40.934885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 592/1178] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:40.940104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:40.940568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:40.940667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:40.958967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:40.960141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:40.967373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:41.025491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 587/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:41.290338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12326-c4af-4b30-be0e-4b6ffce96c10 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:41.309124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:41.388633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12326-c4af-4b30-be0e-4b6ffce96c10 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:41.420823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:41.421432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:41.421703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:41.421968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:41.431492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:41.436008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:41.437696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:46:41.438851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 593/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:41.443686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:41.537660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ad102-8124-416e-ba7f-0eb2c8b88abc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:41.570893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:41.571423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:41.571696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:41.571960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:41.572609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:41.572902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:41.574247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:41.581883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 588/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:41.587754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:41.662720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:41.683281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4c90-0f32-4662-96bb-d87315b81237 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:41.715819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:41.716422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:41.716697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:41.716969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] PATH_INFO: `/v3/users/e8f661923f8244998fad4620ed616cfe` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:41.729291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] RBAC: Authorizing `identity:get_user(user_id=e8f661923f8244998fad4620ed616cfe)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:41.730739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:41.732295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 594/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:41 2022] GET /identity/v3/users/e8f661923f8244998fad4620ed616cfe => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:41.738545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:41.742211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:41.838287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8feb-f824-4599-820f-6b215ee2246c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:41.870336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:41.870948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:41.871223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:41.871488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:41.934681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:41.936117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:41.938558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:42.029113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 589/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:42.035450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:42.129613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e39122-3862-46de-8d11-92e917eb2728 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:42.161506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:42.162105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:42.162383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:42.162682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] PATH_INFO: `/v3/projects/c71effc022f344128c99d04d3715004f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:42.163771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] RBAC: Authorizing `identity:get_project(project_id=c71effc022f344128c99d04d3715004f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:42.165169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1bbac-3ecb-4013-9ff6-3ef253ff3a87 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:42.166792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 595/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:42 2022] GET /identity/v3/projects/c71effc022f344128c99d04d3715004f => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:42.173514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:42.268639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba74e0a-9e30-4592-b075-66d94585b7ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:42.270970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:42.301274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:42.301856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:42.302132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:42.302401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:42.303143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=c71effc022f344128c99d04d3715004f, user.id=e8f661923f8244998fad4620ed616cfe) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:42.303456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:42.304912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2931-d711-493f-b8bb-6b9206517ce7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:42.310762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 590/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:42 2022] GET /identity/v3/role_assignments?user.id=e8f661923f8244998fad4620ed616cfe&scope.project.id=c71effc022f344128c99d04d3715004f&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:44.173279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b246f9-5210-405f-903e-4cd2bcdae516 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:44.173806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b246f9-5210-405f-903e-4cd2bcdae516 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:44.173806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b246f9-5210-405f-903e-4cd2bcdae516 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:44.175192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 596/1186] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:44.180167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:44.180570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:44.180702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:44.198047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:44.199251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:44.261882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 591/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:44.528829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b246f9-5210-405f-903e-4cd2bcdae516 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:44.533218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:44.627210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b246f9-5210-405f-903e-4cd2bcdae516 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:44.660100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:44.660713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:44.660992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:44.661264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:44.671530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:44.676155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:44.677263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:46:44.678486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 597/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:44.683278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:44.773883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:44.777436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353e59b-2ec3-4dbc-9aa0-2fdc2ad8f79f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:44.809924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:44.810541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:44.810841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:44.811111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:44.811765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:44.812060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:44.813408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:44.821231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 592/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:44.827590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:44.888211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:44.925298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c9e2-3744-4f9e-99d4-088e802355e4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:44.957853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:44.958464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:44.958771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:44.959045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] PATH_INFO: `/v3/users/e8f661923f8244998fad4620ed616cfe` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:44.960155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] RBAC: Authorizing `identity:get_user(user_id=e8f661923f8244998fad4620ed616cfe)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:44.961577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:44.963160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 598/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:44 2022] GET /identity/v3/users/e8f661923f8244998fad4620ed616cfe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:46:44.968906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:45.064677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64ca7-c5c2-41d8-9850-cabaed0b566f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:45.096550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:45.097147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:45.097420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:45.097686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] PATH_INFO: `/v3/projects/c71effc022f344128c99d04d3715004f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:45.098797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] RBAC: Authorizing `identity:get_project(project_id=c71effc022f344128c99d04d3715004f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:45.100192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c9c86-a975-4a68-989e-16b69c2e786c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:45.101774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 593/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:44 2022] GET /identity/v3/projects/c71effc022f344128c99d04d3715004f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:45.107515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:45.202713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02733e-be5e-40dd-b18e-df96ede4ee15 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:45.229489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:45.234810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:45.235457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:45.239408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:45.239408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] PATH_INFO: `/v3/projects/c71effc022f344128c99d04d3715004f/users/e8f661923f8244998fad4620ed616cfe/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:45.239408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] RBAC: Authorizing `identity:create_grant(project_id=c71effc022f344128c99d04d3715004f, user_id=e8f661923f8244998fad4620ed616cfe, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:45.239408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbafd3-3906-460e-a502-b6844ec04936 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:45.344570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 599/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:46:45 2022] PUT /identity/v3/projects/c71effc022f344128c99d04d3715004f/users/e8f661923f8244998fad4620ed616cfe/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:46:47.225705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8794-d01c-495b-8740-19f177234f6e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:47.226235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8794-d01c-495b-8740-19f177234f6e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:47.226235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8794-d01c-495b-8740-19f177234f6e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:47.227651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 594/1193] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:46:47.233493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:47.233874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:47.234023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:47.251295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:46:47.252473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:46:47.316116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 600/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:46:47.584040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8794-d01c-495b-8740-19f177234f6e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:47.612297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:47.682322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8794-d01c-495b-8740-19f177234f6e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:47.714233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:47.714872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:47.715149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:47.715413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:47.725573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:46:47.730145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:46:47.731286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:46:47.732194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 595/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:46:47.737149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:47.830038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53b53-a0e6-4606-8b12-640f665d0105 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:47.851558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:47.862903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:47.863523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:47.863795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:47.864061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:47.864704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:47.865000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:47.866337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:47.873993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 601/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:47.879833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:47.964008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:47.975808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfba740-07eb-472e-80ae-79bbd0cf460a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:48.008734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:48.009337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:48.009614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:48.009879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] PATH_INFO: `/v3/users/e8f661923f8244998fad4620ed616cfe` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:48.010995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] RBAC: Authorizing `identity:get_user(user_id=e8f661923f8244998fad4620ed616cfe)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:48.012395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:48.013980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 596/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Aug 12 11:46:47 2022] GET /identity/v3/users/e8f661923f8244998fad4620ed616cfe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:48.019856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:48.119745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf500d0-6c22-4a60-b0cf-f7937a5ef307 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:48.151089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:48.151674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:48.151947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:48.152212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:48.200880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:48.215787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:48.217789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:48.311284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 602/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:46:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:46:48.317332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:48.413001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80e7a-ba84-4773-a241-f9ac97fb1340 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:48.444746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:48.445355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:48.445632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:48.445902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] PATH_INFO: `/v3/projects/c71effc022f344128c99d04d3715004f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:48.447020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] RBAC: Authorizing `identity:get_project(project_id=c71effc022f344128c99d04d3715004f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:48.448430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c73c9-83f0-4782-a31a-8d35540b362b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:48.450026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 597/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Aug 12 11:46:48 2022] GET /identity/v3/projects/c71effc022f344128c99d04d3715004f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:48.456518 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:46:48.536864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:48.551589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210659-9d61-4110-bf2f-7833e0226d53 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:46:48.583974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:46:48.584564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:46:48.584843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:46:48.585115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:46:48.585825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=c71effc022f344128c99d04d3715004f, user.id=e8f661923f8244998fad4620ed616cfe) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:46:48.586128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:46:48.587561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74911693-e1aa-4013-97fd-b7fcb5545954 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:46:48.593619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 603/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:46:48 2022] GET /identity/v3/role_assignments?user.id=e8f661923f8244998fad4620ed616cfe&scope.project.id=c71effc022f344128c99d04d3715004f&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:46:58.440783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:46:58.590549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=26 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:59.284686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd1de-df5f-462e-bb3b-af3cc376f3a4 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:59.285311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd1de-df5f-462e-bb3b-af3cc376f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:59.285311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd1de-df5f-462e-bb3b-af3cc376f3a4 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:59.286595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 598/1201] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:47:59.291737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:59.292138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:59.292275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:59.309924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:47:59.311129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:47:59.376140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 604/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:47:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:47:59.645051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd1de-df5f-462e-bb3b-af3cc376f3a4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:59.744473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd1de-df5f-462e-bb3b-af3cc376f3a4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:59.777670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:59.778285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:59.778583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:59.778852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:59.788437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:59.790304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:47:59.804492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:47:59.806237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:47:59.807273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:47:59.807273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:47:59.807273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:47:59.807273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 599/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:47:59.812427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:47:59.913932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457bb84-7994-44a9-ac1b-29510f125e16 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:47:59.942692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:47:59.948264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:47:59.948958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:47:59.949247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:47:59.949519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:47:59.950154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:47:59.950457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:47:59.951822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e164a7b-b1e9-47d5-a68d-d0453944eb9c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:47:59.962625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 605/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:47:59.968632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:00.021286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:00.066397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ac52b-12ed-4968-99b9-c5af8a0b718c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:00.098815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:00.099408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:00.099682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:00.099948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:00.100575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:00.102554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523059db-18cf-466a-97b8-59a5fc5403bb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:00.194753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 600/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Aug 12 11:47:59 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:48:02.123485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308f4a-2a7a-4433-af0b-1b43a7c6eb2a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.124289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308f4a-2a7a-4433-af0b-1b43a7c6eb2a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.124289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308f4a-2a7a-4433-af0b-1b43a7c6eb2a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.125766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 606/1206] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:02.131005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.131424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.131545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.150340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:02.151568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:02.217583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 601/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:02.484264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308f4a-2a7a-4433-af0b-1b43a7c6eb2a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:02.583496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26308f4a-2a7a-4433-af0b-1b43a7c6eb2a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:02.616352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:02.617540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.617780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.618049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.628173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:02.633398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:02.634675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:02.635578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:02.638404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 607/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:02.644531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:02.700124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:02.757057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da1af0-2e97-4d6c-80eb-e77bc8ff5248 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:02.790184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:02.790816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.791094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.791361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.792030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:02.792328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:02.793685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:02.801331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 602/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:02.807694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:02.857445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:02.904948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013589c-19b7-4bc7-956a-91a765797aa6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:02.939722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:02.940343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:02.940622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:02.940895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:02.951092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:02.952574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:02.966046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:02.967093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:02.968498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:02.968498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:02.968498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:02.968498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 608/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:02.973027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.085034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:03.087917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1dd0e-af5e-46c7-8d04-1216b479d2a1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.121038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.121633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.121907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.122174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.122850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:03.123145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.124736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.135748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 603/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:03.141618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.241446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762498f-7768-49f5-82b4-910c951f83fe None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.243054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:03.276268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.276888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.277165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.277433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.284481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.289660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:03.297550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:03.298714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:03.299857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 609/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:03.304376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.403138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b03b3-96ee-4186-a5da-630e616e6ac4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.436209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.436804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.437111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.437381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.438101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:03.438398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.439852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.457364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 604/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:03.463646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.559702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac2f0b-abb1-4bad-954d-9666304601e7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.592624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.593220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.593499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.593770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.621988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:03.659251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.660633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.753543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 610/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:48:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:48:03.759953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.778582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:03.856912 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a7070-260d-43f4-ba73-9ff1623a98f7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:03.889946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:03.890586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:03.890862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:03.891126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:03.901327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:03.902949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:03.916963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:03.918094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:03.919308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:03.919308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:03.919308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:03.919308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 605/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:03.923886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:03.984264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:04.021872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a998-88d3-4374-bd8a-58c227aff436 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:04.060252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:04.061170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:04.061613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:04.062090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:04.063210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:04.063515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:04.064865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:04.076882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 611/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:04.082684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:04.151647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:04.181908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884261d-f4c9-4fd3-aa28-15ad5759cbf1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:04.214742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:04.215353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:04.215630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:04.215902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:04.222468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:04.223923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:04.234713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:04.238900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:04.240076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 606/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:04.241554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:04.338068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e2db-facf-45bd-8dde-11bd6db32b5c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:04.360301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:04.371804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:04.372401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:04.372676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:04.372946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:04.373882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:04.374182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:04.375615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3282a-7d46-4eb0-a6ff-e4d1502d18e2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:04.386429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 612/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:04.392678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:04.490879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856adc9-d38c-45ac-ad12-e7162bfa5ba5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:04.518597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:04.524517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:04.525112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:04.525383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:04.525649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:04.526360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=845278e5b9a74508acc333f09a2df68a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:04.526714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:04.528125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28abf24-13d0-482f-b7ec-742f26cdeb58 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:04.533298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 607/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:48:04 2022] GET /identity/v3/role_assignments?user.id=845278e5b9a74508acc333f09a2df68a&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:06.393753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa335f3-d375-4f46-aa85-b8b4594bfe52 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:06.394284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa335f3-d375-4f46-aa85-b8b4594bfe52 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:06.394284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa335f3-d375-4f46-aa85-b8b4594bfe52 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:06.395660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 613/1220] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:06.401433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:06.401821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:06.401956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:06.420503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:06.423821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:06.493299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 608/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:06.766543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa335f3-d375-4f46-aa85-b8b4594bfe52 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:06.864888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa335f3-d375-4f46-aa85-b8b4594bfe52 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:06.897552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:06.898805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:06.899069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:06.899342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:06.909129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:06.913735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:06.914827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:06.916128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 614/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:06.920920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.017826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d42e-7563-4e6b-a51c-93543df593eb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.040815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:07.051540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.052160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.052424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.052696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.053360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:07.053662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.055631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.063488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 609/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:07.069394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.114948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:07.168696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c31a-bb92-4784-9e06-341f688042b3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.202673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.203281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.203551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.203842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.213516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.214985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:07.228934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:07.229903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:07.230924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:07.230924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:07.230924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:07.230924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 615/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:07.236281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.340442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8622-97ec-4d2d-803e-67b9b94f6b2f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.373582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.374180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.374454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.374749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.375386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:07.375681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.377155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.388668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 610/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:07.394411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.487107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:07.494063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f617616-07a9-43b4-b9e4-1d2fe20a1527 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.527568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.528181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.528456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.528724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.535567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.539149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:07.548386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:07.549570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:07.550785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 616/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:07.555976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.602242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:07.653167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e162ae-9b19-4342-82ff-b5d53fa12011 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.687421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.688007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.688283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.688554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.689280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:07.689583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.691095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.708335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 611/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:07.715002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.811907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1e8b0-6b99-4a80-a4ae-b1e30a2629fa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.853056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:07.853609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:07.853883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:07.854149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:07.864405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:07.867367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:07.879314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:07.880451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:07.881559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:07.881559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:07.881559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:07.881559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 617/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:07.886492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:07.982845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84f1e-fdd8-4920-b048-14dc962c2971 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:07.985081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:08.015539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:08.022019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:08.030384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 612/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:08.036281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:08.046118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:08.132570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb90eb-89c0-402c-9505-ce7aa9e7642d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:08.165533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:08.166162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:08.166442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:08.166745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:08.173234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:08.174700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:08.185490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:08.186562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:08.187860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 618/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:48:08.192350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:08.291452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65df-0164-42e7-8ac6-edfb380df926 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:08.324621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:08.325218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:08.325500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:08.325770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:08.326455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:08.326786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:08.328198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523622d-6dc4-4eac-8f19-d4c11c4eeb70 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:08.339994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 613/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:08.346023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:08.410473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:08.444037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74aa60-474c-4b96-9668-1b0694936b6f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:08.477609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:08.478258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:08.478556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:08.478832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/845278e5b9a74508acc333f09a2df68a/roles/ea106bcff1884a9caf9cefc6d022b99f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:08.492275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=845278e5b9a74508acc333f09a2df68a, role_id=ea106bcff1884a9caf9cefc6d022b99f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:08.493699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1dd31-617f-4365-89ef-68be307a456b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:08.587499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 619/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:48:08 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/845278e5b9a74508acc333f09a2df68a/roles/ea106bcff1884a9caf9cefc6d022b99f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:48:10.501995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c6ab-4df7-458f-9b06-736a2bd8ea2a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:10.502479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c6ab-4df7-458f-9b06-736a2bd8ea2a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:10.502687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c6ab-4df7-458f-9b06-736a2bd8ea2a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:10.503916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 614/1233] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:10.509681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:10.510101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:10.510222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:10.528444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:10.529667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:10.599807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 620/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:10.888291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c6ab-4df7-458f-9b06-736a2bd8ea2a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:10.916083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:10.990420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c6ab-4df7-458f-9b06-736a2bd8ea2a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.024280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.024900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.025181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.025448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.035235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:11.039833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:11.040942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:11.042175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 615/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Aug 12 11:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:11.047028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.092228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:11.143983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe5805-c8ca-4854-92c2-4773dce459ed None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.182091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.182736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.183021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.183409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.184082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:11.184381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:11.185739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:11.194043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 621/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:11.199932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.287453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:11.302949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495d7d5-8e2d-4cf7-aecd-38f271b7a63c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.334945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.335599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.335871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.336140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.349933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:11.351929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:11.365758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:11.372396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:11.377696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:11.377696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:11.377696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:11.377696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 616/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:11.377986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.473335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50009bb6-e2e9-4498-b9d3-cc8f60824650 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.486608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:11.516054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.516657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.516931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.517205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.517853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:11.518154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:11.519575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:11.531508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 622/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:48:11.537282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.636080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219631b9-b0d0-498b-a3c3-75e781e2677a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.669651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.670265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.670571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.670844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.673440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:11.678176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:11.679637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:11.690195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:11.696184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:11.697165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 617/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:11.697771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.803241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea311c5-328c-457f-90e8-641d254d20f3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.837495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.838096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.838391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.838675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:11.839395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:11.839698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:11.841104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:11.857544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 623/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:48:11.863229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:11.960385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4a2f-86df-42dc-9ff5-c4128284de1b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:11.992737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:11.993337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:11.993612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:11.993877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.053002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:12.059441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.060902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.157797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 618/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:48:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 11:48:12.163669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:12.189958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:12.260409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f051-1847-4f57-bd1c-b23f5902c0f6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:12.292610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:12.293220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:12.293493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:12.293757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.304039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.305523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:12.319755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:12.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:12.322007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:12.322007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:12.322007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:12.322007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 624/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:12.326618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:12.420603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:12.426074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4b818-3959-428d-bf64-4983241e6382 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:12.459666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:12.460322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:12.460604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:12.460875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.461515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:12.461816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.463219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.474332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 619/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:12.480066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:12.557446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:12.578578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde451f-adf8-4574-9b86-89aa5c7afa6b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:12.610154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:12.610789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:12.611065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:12.611333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.618165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.619616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:12.630742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:12.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:12.633265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 625/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:12.637784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:12.736037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722a8c-4ade-4001-897c-e8ce4a1d89e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:12.768656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:12.769271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:12.769535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:12.769836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.770545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:12.770850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.772278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6634c-8aa5-4ae1-be69-682086734e35 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.783849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 620/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:12.790627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:12.888634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6096e01-eea7-4ed5-8db1-7b4341caadad None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:12.924387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:12.924984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:12.925258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:12.925529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:12.926234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] RBAC: Adding query filter params (role.id=ea106bcff1884a9caf9cefc6d022b99f, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=845278e5b9a74508acc333f09a2df68a) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:12.926556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:12.927967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece12d-446f-4a17-bab7-18de15325343 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:12.934281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 626/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:48:12 2022] GET /identity/v3/role_assignments?user.id=845278e5b9a74508acc333f09a2df68a&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=ea106bcff1884a9caf9cefc6d022b99f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:48:14.878771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ac77-e201-47a6-b212-a0c0b73d5bcd None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:14.879320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ac77-e201-47a6-b212-a0c0b73d5bcd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:14.879320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7ac77-e201-47a6-b212-a0c0b73d5bcd None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:14.880650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 621/1247] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:14.886346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:14.886800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:14.890320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:14.893147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:14.905561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:14.906797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:14.970293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 627/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:15.235053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7ac77-e201-47a6-b212-a0c0b73d5bcd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:15.253090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:15.339716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7ac77-e201-47a6-b212-a0c0b73d5bcd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:15.372674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:15.373544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:15.373824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:15.374094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:15.383802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:15.388412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:15.392494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:15.393588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 622/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:15.395555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:15.492739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f76da-f604-41b6-92c5-f76988347b2b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:15.521107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:15.526295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:15.526924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:15.527204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:15.527476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:15.528129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:15.528427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:15.529819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:15.538135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 628/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:15.543934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:15.618946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:15.641588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd407e-986b-40c0-985d-6edc90a81c75 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:15.673879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:15.674489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:15.674794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:15.675061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:15.684617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:15.686044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:15.701268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:15.702457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:15.703774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:15.703774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:15.703774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:15.703774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 623/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:15.708892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:15.807867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a37fe0-1b08-45da-96d9-017d8bd1dce3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:15.841375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:15.841975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:15.842252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:15.842533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:15.843179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:15.843476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:15.844821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:15.856360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 629/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:15.862076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:15.959110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34b60e-56fc-4538-b1c9-d90e7a131f40 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:15.984665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:15.992818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:15.993435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:15.993717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:15.993990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.001648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.003428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:16.014692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:16.023830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:16.025040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 624/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:16.025808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:16.076919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:16.121315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbfad9-0dd9-487c-ac51-d09e5e7dccb8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:16.156270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:16.157282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:16.157593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:16.157996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.159133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:16.159591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.161809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.186201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 630/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:16.192216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:16.289158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d521e-fcf8-4ab3-9526-b431d4f39144 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:16.322149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:16.322775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:16.323052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:16.323319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.376881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:16.388612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.390035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.487607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 625/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:48:16.493980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:16.594933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47902115-deb1-47b0-ab0f-06a30d2964e6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:16.608104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:16.629422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:16.629980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:16.630257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:16.630535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.640210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.641628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:16.655506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:16.656644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:16.657724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:16.657724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:16.657724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:16.657724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 631/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:16.662907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:16.747627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:16.759635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7140-ea2e-4d4d-a803-3aea02ffe195 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:16.796744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:16.797387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:16.797675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:16.797946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.798625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:16.798932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.800292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.811844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 626/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:16.817730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:16.917854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b6412-6a03-43f1-a24c-48bd4f58663b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:16.950621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:16.951240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:16.951515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:16.951781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:16.958309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:16.960257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:16.970913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:16.972019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:16.973171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 632/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:16.978417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:17.077862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6af595-3991-40fc-86ca-09ce2f1aaaaa None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:17.112973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:17.113577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:17.113854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:17.114122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:17.114837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:17.115135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:17.116536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498036d-54b4-4f5b-98e8-7caed9b61e82 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:17.129516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 627/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:17.136234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:17.161873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:17.231807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b56eb9-361b-473b-a660-e4cae5eedf75 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:17.264776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:17.266025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:17.266025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:17.266025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:17.266656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=845278e5b9a74508acc333f09a2df68a) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:17.266957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:17.268346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1da052-df5b-4a1e-9711-5e526b4d6226 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:17.274029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 633/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:48:17 2022] GET /identity/v3/role_assignments?user.id=845278e5b9a74508acc333f09a2df68a&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:19.141481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079d5f-0d8b-4a2f-baba-0f6328afde8d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:19.142036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079d5f-0d8b-4a2f-baba-0f6328afde8d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:19.142036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079d5f-0d8b-4a2f-baba-0f6328afde8d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:19.143393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 628/1261] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:19.149061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:19.149573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:19.149674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:19.167817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:19.169015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:19.233766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 634/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:19.506507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079d5f-0d8b-4a2f-baba-0f6328afde8d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:19.517426 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:19.603090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079d5f-0d8b-4a2f-baba-0f6328afde8d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:19.636357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:19.636979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:19.637251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:19.637514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:19.648108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:19.652689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:19.654609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:19.655883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 629/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:19.659941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:19.678181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:19.756438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14379a-f5ca-4db1-9b54-7cb341ba3bc7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:19.789541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:19.790156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:19.790433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:19.790732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:19.791397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:19.791699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:19.793050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:19.801106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 635/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:19.809175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:19.874182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:19.906557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674b7c2-6330-4b28-ba35-dbaceacaff9b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:19.939290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:19.939925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:19.940275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:19.940543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:19.951409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:19.952832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:19.967123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:19.968263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:19.969221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:19.969221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:19.969221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:19.969221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 630/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:19.974032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.051835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:20.070911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d8c2-4f1f-4580-8cb6-b93dec37c79d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.104325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.104913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.105188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.105453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.106085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:20.106383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.107754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.119756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 636/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:20.125561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.223038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e29-3557-4b95-af8c-dae50a2a4ce8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.243312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:20.257339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.257950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.258231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.258501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.265616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.267155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:20.277834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:20.278974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:20.280184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 631/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:20.284793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.383130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89832a-1f7c-427b-82f8-07501522b486 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.416041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.416723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.416938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.417212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.417938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:20.418241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.419698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.429566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:20.437480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 637/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:20.443523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.544291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82d5c-c711-4c9a-bf50-6a13fb1bdbf1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.577027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.577636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.577919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.578194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.589923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.591410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:20.606126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:20.607157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:20.608204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:20.608204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:20.608204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:20.608204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 632/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:20.613286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.716627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70133-7aba-445d-914a-4edafbc377d5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.751663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.752266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.752543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.752815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.753454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:20.753754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.755138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.765879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 638/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:20.772181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.803633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:20.869210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75714c-e32c-40f5-81f1-d7a529f3dfa4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:20.903662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:20.904275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:20.904549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:20.904815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:20.911174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:20.912651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:20.923670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:20.924737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:20.925716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 633/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:48:20.930756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:20.990080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:21.030021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b522-96fe-456c-af82-002aad7e6991 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:21.061139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:21.061732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:21.062010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:21.062281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:21.062989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:21.063294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:21.064696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250af937-ecb0-4d10-93c4-ba05f99c88b0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:21.076648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 639/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:21.082692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:21.177909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:21.186164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7826dd-cd9f-4536-b9c2-89b6754ad75a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:21.219105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:21.221286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:21.221286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:21.221286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] PATH_INFO: `/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/845278e5b9a74508acc333f09a2df68a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:21.222137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] RBAC: Authorizing `identity:create_grant(project_id=64bceedd397d42d19ba79e9b3144c832, user_id=845278e5b9a74508acc333f09a2df68a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:21.223575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc93dfe-0e88-49c4-9b98-c2ce228bbc39 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:21.299939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 634/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Aug 12 11:48:21 2022] PUT /identity/v3/projects/64bceedd397d42d19ba79e9b3144c832/users/845278e5b9a74508acc333f09a2df68a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:48:23.153660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c75d7-a424-4e8d-8ea5-4985d49814e1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:23.154231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c75d7-a424-4e8d-8ea5-4985d49814e1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:23.154231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c75d7-a424-4e8d-8ea5-4985d49814e1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:23.155544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 640/1274] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:23.164440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:23.164831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:23.164982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:23.183305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:23.184489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:23.248730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 635/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:23.513132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c75d7-a424-4e8d-8ea5-4985d49814e1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:23.613239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c75d7-a424-4e8d-8ea5-4985d49814e1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:23.629853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:23.645307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:23.646453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:23.646744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:23.647012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:23.656430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 11:48:23.660946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:23.664854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:23.665759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 641/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Aug 12 11:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:23.668904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:23.746907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:23.764921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f24a-bcb1-4b0e-8618-db0f38979595 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:23.797945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:23.802900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:23.803232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:23.803517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:23.804187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:23.804631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:23.806096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:23.814689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 636/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Aug 12 11:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:23.821144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:23.919195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ba38-930a-44a5-ad61-722cff0957fc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:23.952349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:23.952956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:23.953235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:23.953507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:23.964154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:23.965595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:23.979739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:23.980884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:23.982079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:23.982079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:23.982079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:23.982079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 642/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:23.986805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:24.085695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7655df7-e2f4-4cd9-8619-af5b6ed3c4d2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:24.118444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:24.119065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:24.119338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:24.119605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:24.120240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:24.120605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:24.121905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:24.134290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 637/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:24.140163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:24.171013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:24.244837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952721-e55b-424e-b288-c14e73c1a849 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:24.279107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:24.279728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:24.280009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:24.280283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:24.287107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:24.288576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 11:48:24.299827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:24.304859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:24.306321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 643/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:24.307218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:24.311020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:24.403465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2aa2c-62c9-4bf9-a23d-770fdf0cfd3e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:24.436751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:24.437348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:24.437624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:24.437894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:24.438645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:24.440600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:24.440600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:24.457646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 638/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Aug 12 11:48:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:24.463479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:24.558446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:24.568661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f05419-0e82-4149-81cf-fab208555aba None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:24.602703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:24.603340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:24.603613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:24.603884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:24.677089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:24.679142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:24.772876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:24.783414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 644/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Aug 12 11:48:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 11:48:24.789818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:24.859901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:24.899658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa990ba-b7eb-490e-88c8-30fda1a55b6e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:24.937508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:24.938060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:24.938336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:24.938638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:24.949402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:24.955043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 11:48:24.966237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:24.967548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 11:48:24.968697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 11:48:24.968697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 11:48:24.968697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:24.968697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 639/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:24.973242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:25.076512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05b58-0bd7-4716-b112-7fa6794878b0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:25.110111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:25.110810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:25.111084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:25.111350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:25.111979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:25.112271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:25.113611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:25.124997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 645/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Aug 12 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:25.130836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:25.229013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d55c-a0d4-4dd7-80f9-c970fc8bfe60 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:25.241793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:25.261119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:25.261736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:25.262014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:25.262283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:25.268685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:25.270101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 11:48:25.281261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:25.282153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 12 11:48:25.283226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 640/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Aug 12 11:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:25.289065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:25.338492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:25.386181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245f71-e3fc-4f6e-8eac-f7b7abcd42c7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:25.419175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:25.419859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:25.420129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:25.420392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:25.421062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:25.421358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:25.422783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87e2a-fb74-4c13-a40d-7ad5712b0098 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:25.434303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 646/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Aug 12 11:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:25.440508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:25.541443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747d15-9048-4c34-af58-0421fb6cf6ec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:25.573705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:25.574302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:25.574601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:25.574871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:25.575579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] RBAC: Adding query filter params (role.id=5540f9b1011544929fd18ae216a070b0, scope.project.id=64bceedd397d42d19ba79e9b3144c832, user.id=845278e5b9a74508acc333f09a2df68a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:25.575880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:25.577280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427ea64-5f87-4ddc-8b01-8744b241c69c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:25.582910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 641/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Aug 12 11:48:25 2022] GET /identity/v3/role_assignments?user.id=845278e5b9a74508acc333f09a2df68a&scope.project.id=64bceedd397d42d19ba79e9b3144c832&role.id=5540f9b1011544929fd18ae216a070b0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:27.513910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79551-a590-411c-b101-8c5dc840e25a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:27.514434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79551-a590-411c-b101-8c5dc840e25a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:27.514434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab79551-a590-411c-b101-8c5dc840e25a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:27.515809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 647/1288] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:27.520937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:27.521357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:27.521450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:27.539049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:27.540223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:27.569263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:27.604662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 642/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:27.874116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79551-a590-411c-b101-8c5dc840e25a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:27.970706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab79551-a590-411c-b101-8c5dc840e25a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:27.981362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:28.013639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:28.014264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:28.014564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:28.014837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:28.015416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:28.016755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:28.026304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:28.027705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:28.028596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 648/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:48:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 11:48:28.033758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:28.131184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5b4d8-7940-42b9-bd7b-e6cf3da28e5c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:28.165253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:28.165849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:28.166125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:28.166422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:28.167153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:28.167451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:28.168804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3455-dacd-4063-b904-79348a078c21 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:28.173473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 643/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Aug 12 11:48:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:28.179466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:28.275539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527a16-528d-4702-90c4-4f22f9ef0425 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:28.307642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:28.308236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:28.308514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:28.308787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:28.309407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:28.309706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:28.311087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8bc18-8517-4427-a192-1933041ab1bd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:28.315318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 649/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Aug 12 11:48:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:48:30.267749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689be4-ac41-4fd3-9480-c908c9a3dc27 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:30.268313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689be4-ac41-4fd3-9480-c908c9a3dc27 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:30.268313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689be4-ac41-4fd3-9480-c908c9a3dc27 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:30.269655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 644/1293] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:30.275245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd35a3-cb04-4e40-a116-84ab48827fdb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:30.275626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd35a3-cb04-4e40-a116-84ab48827fdb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:30.275795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd35a3-cb04-4e40-a116-84ab48827fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:30.294150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c4cd35a3-cb04-4e40-a116-84ab48827fdb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:30.295381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c4cd35a3-cb04-4e40-a116-84ab48827fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:30.323643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:30.359562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 650/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:30.623591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43689be4-ac41-4fd3-9480-c908c9a3dc27 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:30.654670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:30.723240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43689be4-ac41-4fd3-9480-c908c9a3dc27 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:30.756164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:30.756751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:30.757026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:30.757294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:30.757920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:30.759323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72925fb9-34f3-4646-8fed-4c930a2df80e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:30.814401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 645/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Aug 12 11:48:30 2022] POST /identity/v3/services => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:48:32.714172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450199f-7769-4a28-92d4-c2acb0563cf2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:32.714756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450199f-7769-4a28-92d4-c2acb0563cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:32.714756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450199f-7769-4a28-92d4-c2acb0563cf2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:32.716210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 651/1296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:32.721796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:32.721796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:32.721796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:32.740570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:32.741746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:32.815819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 646/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:33.081318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450199f-7769-4a28-92d4-c2acb0563cf2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:33.182581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450199f-7769-4a28-92d4-c2acb0563cf2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:33.216742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:33.217355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:33.217628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:33.217893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:33.218503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:33.221766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:33.228985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:33.229978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:33.230938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 652/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:48:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:33.236244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:33.254561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:33.330356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b7ca-f17f-4ce7-a474-5123e5e7b2ab None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:33.363341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:33.365962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:33.365962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:33.365962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:33.365962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:33.365962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:33.366760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:33.371889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 647/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Aug 12 11:48:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 11:48:33.377798 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:33.408549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:33.484849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca91ef0-3ff0-4f4c-9675-30fa09259901 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:33.517793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:33.518392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:33.518699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:33.518977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:33.519683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] RBAC: Adding query filter params (interface=public, service_id=2444c91961a2455d910068f688b7944d, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:33.520503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:33.521847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbfbe9-5347-4e78-b68e-6f5abf37505e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:33.526642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 653/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Aug 12 11:48:33 2022] GET /identity/v3/endpoints?service_id=2444c91961a2455d910068f688b7944d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:33.532417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:33.611521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:33.633048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606e971-7701-4495-ae0e-ccdebe0b88c0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:33.662722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:33.663315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:33.663595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:33.663862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:33.664463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:33.665814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6237-05bc-4002-94e2-4cd9a8fcc176 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:33.672399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 648/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Aug 12 11:48:33 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:48:35.536206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7318-1202-40ee-a457-e869d4dc44c9 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:35.536689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7318-1202-40ee-a457-e869d4dc44c9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:35.536779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7318-1202-40ee-a457-e869d4dc44c9 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:35.538069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 654/1302] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:48:35.543419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:35.543814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:35.543965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:35.561487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:48:35.562699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:48:35.627459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 649/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:48:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 11:48:35.894114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b7318-1202-40ee-a457-e869d4dc44c9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:35.987235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:35.994178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b7318-1202-40ee-a457-e869d4dc44c9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:36.026486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:36.027123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:36.027396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:36.027671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:36.028239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:36.029652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 11:48:36.038493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 11:48:36.039627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 12 11:48:36.040474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 655/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Aug 12 11:48:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 11:48:36.045603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:36.119813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:36.142010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aea1b-fa67-4d71-99c8-815031000fa8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:36.175771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:36.176878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:36.177140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:36.177408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:36.178032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:48:36.178329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:36.179747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a9b5-8401-47cf-9ca0-94c58bc01260 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:36.184759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 650/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Aug 12 11:48:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:48:36.190615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:48:36.286435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625504f7-9698-4b5e-ac69-0c91e882a350 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:48:36.319070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:48:36.319652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:48:36.319931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:48:36.320199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:48:36.320837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:48:36.322207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d392e-f39d-4b6e-8f5b-501af8bbefc0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:48:36.385617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 656/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:48:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:48:46.181732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=30 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:48:46.381084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:23.209411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e99e-baa1-4159-b608-87d8399153d4 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:23.209993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e99e-baa1-4159-b608-87d8399153d4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:23.209993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e99e-baa1-4159-b608-87d8399153d4 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:23.215812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 651/1307] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:23.217326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ec4a-7ca9-4047-8b26-56c056a8d18c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:23.217748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ec4a-7ca9-4047-8b26-56c056a8d18c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:23.218044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ec4a-7ca9-4047-8b26-56c056a8d18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:23.339577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f7a3ec4a-7ca9-4047-8b26-56c056a8d18c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:23.341229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7a3ec4a-7ca9-4047-8b26-56c056a8d18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:23.507372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 657/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:23.794236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:23.794588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:23.794814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:23.796444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 652/1309] 10.222.0.18 () {54 vars in 965 bytes} [Fri Aug 12 11:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:23.802584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa79f1-4029-4bcd-92b0-1ad9679963b9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:23.803005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa79f1-4029-4bcd-92b0-1ad9679963b9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:23.803412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa79f1-4029-4bcd-92b0-1ad9679963b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:23.886976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-06aa79f1-4029-4bcd-92b0-1ad9679963b9 None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:23.888675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-06aa79f1-4029-4bcd-92b0-1ad9679963b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:23.912577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:23.975754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 658/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Fri Aug 12 11:54:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:54:23.985073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:23.987108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:24.122324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbc65-e0c1-451e-93bb-c82f86a4363e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:24.206736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:24.207277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:24.207558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:24.207829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:24.209538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:24.270761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:24.333987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:24.335852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abefd8c-dda5-4d46-8492-e00c7fb8ebd1 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:24.358826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 653/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:54:26.597836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:26.598379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:26.598379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:26.599784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 659/1312] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:26.605425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82330-d060-4939-9385-f0e8ea4263b0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:26.605934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82330-d060-4939-9385-f0e8ea4263b0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:26.606024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82330-d060-4939-9385-f0e8ea4263b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:26.683300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-93a82330-d060-4939-9385-f0e8ea4263b0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:26.684556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-93a82330-d060-4939-9385-f0e8ea4263b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:26.783184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 654/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:27.072465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:27.074016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:27.175276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9eeb-985d-4866-b5bb-d8675c03fdd3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:27.245250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:27.247728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:27.248337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:27.248615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:27.248886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:27.250489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:27.362686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:27.364098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ec5cc-7fe8-495c-8c67-ea8ea233e35e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:27.382105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 660/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:29.729083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:29.729610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:29.729610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:29.730953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 655/1315] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:29.735893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49a4e-86d4-461a-9805-bc9944aa7ffc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:29.736294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49a4e-86d4-461a-9805-bc9944aa7ffc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:29.736462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49a4e-86d4-461a-9805-bc9944aa7ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:29.800482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1cd49a4e-86d4-461a-9805-bc9944aa7ffc None None] MFA Rules not processed for user `d489e73bfdd74cd59722698ff230be22`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:29.801660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1cd49a4e-86d4-461a-9805-bc9944aa7ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:29.851478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:29.894074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 661/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:30.176504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:30.178084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:30.187853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:30.284119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6da423-275d-40b2-a6a7-1d6865c91554 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:30.360924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:30.361523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:30.361917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:30.362189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:30.363807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:30.425257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:30.471610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:30.473043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067118b-69e0-47b9-adfa-eb66d8f2fc6f service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:30.491407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 656/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:33.238122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759270-2ab9-410d-aa15-7324423a002d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:33.238658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759270-2ab9-410d-aa15-7324423a002d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:33.238658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60759270-2ab9-410d-aa15-7324423a002d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:33.239961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 662/1318] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:33.245462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1152e-95eb-4b97-adbb-2f47931a9bb7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:33.245835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1152e-95eb-4b97-adbb-2f47931a9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:33.246015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1152e-95eb-4b97-adbb-2f47931a9bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:33.311148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3ed1152e-95eb-4b97-adbb-2f47931a9bb7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:33.312339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3ed1152e-95eb-4b97-adbb-2f47931a9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:33.405322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 657/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:33.701811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:33.702095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:33.702366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:33.703726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 663/1320] 10.222.0.18 () {54 vars in 965 bytes} [Fri Aug 12 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:33.709607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ba53-1203-418c-aad8-313b33132a61 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:33.709918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ba53-1203-418c-aad8-313b33132a61 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:33.710194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ba53-1203-418c-aad8-313b33132a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:33.732087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:33.784286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-af36ba53-1203-418c-aad8-313b33132a61 None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:33.785472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-af36ba53-1203-418c-aad8-313b33132a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:33.858888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 658/1321] 10.222.0.18 () {58 vars in 1062 bytes} [Fri Aug 12 11:54:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:33.867683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:33.869203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:33.969678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4838af4-8432-4c97-a984-3a7ae3d234a7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:34.040727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:34.045499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:34.045499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:34.045499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:34.045499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:34.051486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:34.278776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:34.280162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237bf37-e3ed-4898-ba9f-79dcb7b5baef service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:34.299361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 664/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:37.714890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:37.715427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:37.715682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:37.717025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 659/1323] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:37.722347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357730bc-2b86-47cd-b49b-506175baecc1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:37.722804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357730bc-2b86-47cd-b49b-506175baecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:37.722900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357730bc-2b86-47cd-b49b-506175baecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:37.786598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-357730bc-2b86-47cd-b49b-506175baecc1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:37.787811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-357730bc-2b86-47cd-b49b-506175baecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:37.844248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:37.881559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 665/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:38.158784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:38.160393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:38.275757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee276ef3-b303-4d62-943c-f3e5d0aa1ba0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:38.288516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:38.352709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:38.353848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:38.354121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:38.354391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:38.356029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:38.470412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:38.471887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef9b94-1670-451f-8f64-efc00bd8b57e service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:38.490239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 660/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:40.447498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:40.448054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:40.448054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:40.449375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 666/1326] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:40.454849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616270-a507-4ed2-b3d6-fb5771a1c050 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:40.455313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616270-a507-4ed2-b3d6-fb5771a1c050 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:40.455424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616270-a507-4ed2-b3d6-fb5771a1c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:40.503048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:40.520676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-01616270-a507-4ed2-b3d6-fb5771a1c050 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:40.521892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-01616270-a507-4ed2-b3d6-fb5771a1c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:40.617961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 661/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:40.897496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:40.899141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:41.006384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faa325-a412-49c1-a214-4b0ea27b2e19 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:41.080765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:41.081427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:41.081708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:41.081974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:41.083634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:41.101088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:41.201666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:41.203144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5e372-b666-4ac7-9b6a-06e9695b5db5 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:41.221328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 667/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:43.203802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:43.204367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:43.204367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:43.206497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 662/1329] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:43.211844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613c3b-7e18-414b-95c7-641a12b36676 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:43.212265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613c3b-7e18-414b-95c7-641a12b36676 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:43.212904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613c3b-7e18-414b-95c7-641a12b36676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:43.277654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fa613c3b-7e18-414b-95c7-641a12b36676 None None] MFA Rules not processed for user `d489e73bfdd74cd59722698ff230be22`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:43.278816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fa613c3b-7e18-414b-95c7-641a12b36676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:43.341419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:43.372345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 668/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:43.656718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:43.658292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:43.761794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ce4e-4795-4935-bb76-bbbc6a23e7be None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:43.780672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:43.844150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:43.844776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:43.845056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:43.845318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:43.847166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:43.971402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:43.972831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999c48b-e0a7-41fb-92bf-7279179b083a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:43.990215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 663/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:46.331256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.331836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.331836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.333103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 669/1332] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:46.338336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1854c-79cc-41e9-97c3-5433504cac43 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.338776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1854c-79cc-41e9-97c3-5433504cac43 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.338921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1854c-79cc-41e9-97c3-5433504cac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.401827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:46.404302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-69a1854c-79cc-41e9-97c3-5433504cac43 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:46.405508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-69a1854c-79cc-41e9-97c3-5433504cac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:46.502072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 664/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:46.784077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:46.785623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:46.887813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5636858-509d-4a02-906b-475e4cc51320 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:46.959276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:46.959878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:46.960158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:46.960430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:46.962014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:46.990444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:47.077355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:47.078833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b775b8b-a120-4ad2-8ac4-001adb90f2cb service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:47.098078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 670/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:49.037462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:49.038032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:49.038032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:49.039620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 665/1335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:49.045307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225b59-c533-41b3-9091-7540cd227422 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:49.055067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225b59-c533-41b3-9091-7540cd227422 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:49.055067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225b59-c533-41b3-9091-7540cd227422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:49.109510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-16225b59-c533-41b3-9091-7540cd227422 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:49.110742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-16225b59-c533-41b3-9091-7540cd227422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:49.182337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:49.203530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 671/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:54:49.486343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:49.487955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:49.593089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9455-6af5-46ad-bbfe-ab3f02ff99f9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:49.624068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:49.669382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:49.670013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:49.670290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:49.670592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:49.672227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:49.778262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:49.779638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90627799-2f0f-4c78-9e54-6722881def0b service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:49.797553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 666/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:52.354765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:52.358549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:52.358549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:52.358549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 672/1338] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:52.361753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698525-0a06-4014-a3d1-94f8dc47ea6c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:52.362202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698525-0a06-4014-a3d1-94f8dc47ea6c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:52.362330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1698525-0a06-4014-a3d1-94f8dc47ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:52.428823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c1698525-0a06-4014-a3d1-94f8dc47ea6c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:52.430054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1698525-0a06-4014-a3d1-94f8dc47ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:52.438772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:52.530723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 667/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:52.814231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:52.815811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:52.917124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5b494-ae42-4fc2-ba63-37ad1391bd3e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:52.988261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:52.988866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:52.989144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:52.989415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:52.991044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:53.026035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:53.097110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:53.098542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680c84c-cf88-4bc9-9e4f-4ce61063ac2f service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:53.117531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 673/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:54:57.288930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:57.289742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:57.289742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:57.291685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 668/1341] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:54:57.296870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcd74-135c-40c1-b6cb-a4f8620277a6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:57.297308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcd74-135c-40c1-b6cb-a4f8620277a6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:57.297402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcd74-135c-40c1-b6cb-a4f8620277a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:57.361568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4c8bcd74-135c-40c1-b6cb-a4f8620277a6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:54:57.362720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4c8bcd74-135c-40c1-b6cb-a4f8620277a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:57.448718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:57.459668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 674/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:54:57.744197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:54:57.745814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:57.848403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62515cae-e669-4d3a-9013-db720e0df5b6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:54:57.887332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:54:57.923765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:54:57.924371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:54:57.924650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:54:57.924922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:54:57.926538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:54:58.050559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:54:58.050559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d8e86-e205-4ddc-a945-e71a1539a9e6 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:54:58.069181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 669/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:01.111044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:01.111599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:01.111599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:01.112921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 675/1344] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:01.118076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521067f-e5af-4102-822c-dde43e50ab05 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:01.119070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521067f-e5af-4102-822c-dde43e50ab05 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:01.119326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521067f-e5af-4102-822c-dde43e50ab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:01.186064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8521067f-e5af-4102-822c-dde43e50ab05 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:01.187364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8521067f-e5af-4102-822c-dde43e50ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:01.205647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:01.290633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 670/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:01.576989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:01.578612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:01.687538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a272c-3dba-4cc5-99bd-d3bb213cd8ef None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:01.760320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:01.760937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:01.761212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:01.761477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:01.763085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:01.806510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:01.873585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:01.875033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614165c-9c0b-4a70-8653-29472c8f7189 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:01.894000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 676/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:06.166159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:06.166775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:06.166869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:06.169354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 671/1347] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:06.174074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a409-4ced-43d5-9e5a-31272e02fe35 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:06.174549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a409-4ced-43d5-9e5a-31272e02fe35 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:06.174643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a409-4ced-43d5-9e5a-31272e02fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:06.245442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2e61a409-4ced-43d5-9e5a-31272e02fe35 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:06.246779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2e61a409-4ced-43d5-9e5a-31272e02fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:06.362091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:06.364804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 677/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:06.652431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:06.653964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:06.762104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaeaa8-c04f-405e-a9cf-ffa9214ebf4e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:06.810049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:06.835585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:06.836193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:06.836515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:06.836813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:06.838437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:06.948770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:06.950197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11da28-1b89-468b-9e47-658aa2a5633d service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:06.968394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 672/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:11.869288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789872-27de-47a7-8a94-3e624299da42 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:11.869714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789872-27de-47a7-8a94-3e624299da42 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:11.870193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789872-27de-47a7-8a94-3e624299da42 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:11.871505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 678/1350] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 11:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:11.876751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022aca-584a-400d-80b2-f6d4719c4f2f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:11.877497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022aca-584a-400d-80b2-f6d4719c4f2f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:11.877920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022aca-584a-400d-80b2-f6d4719c4f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:11.983685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fb022aca-584a-400d-80b2-f6d4719c4f2f None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:11.984837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fb022aca-584a-400d-80b2-f6d4719c4f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:12.009763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:12.159035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 673/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:16.427016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f146-808a-4656-a88e-ccacc27c6d31 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:16.427792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f146-808a-4656-a88e-ccacc27c6d31 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:16.428161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60f146-808a-4656-a88e-ccacc27c6d31 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:16.429785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 679/1352] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 11:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:16.435434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7f83-830a-48a8-aa2b-0bf96864a409 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:16.436219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7f83-830a-48a8-aa2b-0bf96864a409 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:16.436692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c7f83-830a-48a8-aa2b-0bf96864a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:16.517796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f49c7f83-830a-48a8-aa2b-0bf96864a409 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:16.519025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f49c7f83-830a-48a8-aa2b-0bf96864a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:16.595299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:16.632452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 674/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:18.013527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357bce-055d-49d1-af81-4ced2bccf931 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:18.014063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357bce-055d-49d1-af81-4ced2bccf931 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:18.014304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357bce-055d-49d1-af81-4ced2bccf931 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:18.015716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 680/1354] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 11:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:18.021126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ab5b-c771-492f-9684-dd64a932dfa8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:18.021549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ab5b-c771-492f-9684-dd64a932dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:18.021826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ab5b-c771-492f-9684-dd64a932dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:18.098189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9173ab5b-c771-492f-9684-dd64a932dfa8 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:18.099528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9173ab5b-c771-492f-9684-dd64a932dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:18.212494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 675/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 11:55:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:21.389285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7e50-463d-4520-a777-621ba525efa7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:21.389821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7e50-463d-4520-a777-621ba525efa7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:21.390743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7e50-463d-4520-a777-621ba525efa7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:21.392429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 681/1356] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:21.397776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99118-fd10-4dbe-a2c8-cbcf0ad90302 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:21.398236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99118-fd10-4dbe-a2c8-cbcf0ad90302 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:21.398332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f99118-fd10-4dbe-a2c8-cbcf0ad90302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:21.441618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:21.492245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-03f99118-fd10-4dbe-a2c8-cbcf0ad90302 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:21.493467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-03f99118-fd10-4dbe-a2c8-cbcf0ad90302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:21.619731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 676/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:21.923878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:21.924449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:21.925008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:21.926617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 682/1358] 10.222.0.18 () {54 vars in 962 bytes} [Fri Aug 12 11:55:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:21.936202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54c4a-23be-47dc-a4fb-66bec4e3463f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:21.936669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54c4a-23be-47dc-a4fb-66bec4e3463f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:21.937713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54c4a-23be-47dc-a4fb-66bec4e3463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:22.020349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0ca54c4a-23be-47dc-a4fb-66bec4e3463f None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:22.023504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0ca54c4a-23be-47dc-a4fb-66bec4e3463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:22.073444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:22.149973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 677/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Aug 12 11:55:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:22.157698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:22.159349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:22.329611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad0912-2ac0-4106-bf9d-8e017ae1a96e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:22.410401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:22.461724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:22.462422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:22.462843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:22.463219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:22.464876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:22.560594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:22.562299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40272ef8-468c-4088-9f7c-466789dbb04b service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:22.581500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 683/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:24.695658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:24.696274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:24.696274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:24.698950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 678/1361] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:24.702903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b539f-0c15-4c34-b908-e3b0badd42a7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:24.703361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b539f-0c15-4c34-b908-e3b0badd42a7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:24.703443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b539f-0c15-4c34-b908-e3b0badd42a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:24.778251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f09b539f-0c15-4c34-b908-e3b0badd42a7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:24.779676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f09b539f-0c15-4c34-b908-e3b0badd42a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:24.818675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:24.883014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 684/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:25.173025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:25.174628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:25.364725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a991-4b56-41e1-b21b-c42cb2d23c11 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:25.375279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:25.492039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:25.492677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:25.493063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:25.493322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:25.494979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:25.596010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:25.597723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b9699-d176-4e9c-8c5f-00b3f860872a service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:25.616491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 679/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:28.004463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096d27-c3c0-48fc-90ab-4f8fcee5a37c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.005001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096d27-c3c0-48fc-90ab-4f8fcee5a37c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.005001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c096d27-c3c0-48fc-90ab-4f8fcee5a37c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.006304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 685/1364] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:28.011733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c197-b03b-4040-acc5-8f7319445fc6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.012151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c197-b03b-4040-acc5-8f7319445fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.012360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12c197-b03b-4040-acc5-8f7319445fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.028753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:28.080329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8a12c197-b03b-4040-acc5-8f7319445fc6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:28.081519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8a12c197-b03b-4040-acc5-8f7319445fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.182956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 680/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:28.486864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.487293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.487691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.489575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 686/1366] 10.222.0.18 () {54 vars in 962 bytes} [Fri Aug 12 11:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:28.495777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a50b-1134-4b9d-8d30-f244ad3a098d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:28.498570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a50b-1134-4b9d-8d30-f244ad3a098d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:28.498570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a50b-1134-4b9d-8d30-f244ad3a098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:28.581158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5cb6a50b-1134-4b9d-8d30-f244ad3a098d None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:28.582750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cb6a50b-1134-4b9d-8d30-f244ad3a098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.620429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:28.713038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 681/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Aug 12 11:55:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:28.721125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:28.722822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:28.884499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82fb3e-8361-4540-addc-c4ef1892cc2e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:28.905996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:29.009650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:29.010335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.010565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.010843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.012562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:29.106404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:29.108011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c82cf-3d61-48e7-93a8-341980d0d9de service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:29.127443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 687/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:29.587114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6564-8bb2-4525-8e92-230cda31b73b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.587652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6564-8bb2-4525-8e92-230cda31b73b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.587652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b6564-8bb2-4525-8e92-230cda31b73b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.589129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 682/1369] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:29.594110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e89e1-9c77-4672-b763-a07a3d39ab66 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:29.594392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e89e1-9c77-4672-b763-a07a3d39ab66 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:29.594770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e89e1-9c77-4672-b763-a07a3d39ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:29.626817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:29.662624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0f5e89e1-9c77-4672-b763-a07a3d39ab66 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:29.663835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0f5e89e1-9c77-4672-b763-a07a3d39ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:29.765303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 688/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:30.342932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:30.343216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:30.343484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:30.345075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 683/1371] 10.222.0.18 () {54 vars in 964 bytes} [Fri Aug 12 11:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:30.349989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7442fb-b865-42a2-b08e-aa16dd09b47b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:30.350478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7442fb-b865-42a2-b08e-aa16dd09b47b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:30.350807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7442fb-b865-42a2-b08e-aa16dd09b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:30.432096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6f7442fb-b865-42a2-b08e-aa16dd09b47b None None] MFA Rules not processed for user `971fc696d71f4812bf3e50bafb3871a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:30.433584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6f7442fb-b865-42a2-b08e-aa16dd09b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:30.492056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:30.522925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 689/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Aug 12 11:55:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:30.538009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:30.540042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:30.645669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4219e3-d689-49f6-9c31-fc9e11fcf0d2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:30.686215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:30.722886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:30.724525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:30.725010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:30.725838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:30.727502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:30.850752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:30.852484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9a4fc-cadc-4909-9ccd-0a8b3f4635db service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:30.878646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 684/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:31.278291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:31.278622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:31.278899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:31.280270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 690/1374] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:31.285677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d326d0-9f5a-44fa-be45-5204c9d086b1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:31.285966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d326d0-9f5a-44fa-be45-5204c9d086b1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:31.286266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d326d0-9f5a-44fa-be45-5204c9d086b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:31.352302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-62d326d0-9f5a-44fa-be45-5204c9d086b1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:31.353505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62d326d0-9f5a-44fa-be45-5204c9d086b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:31.374138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:31.454264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 685/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:31.748507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:31.750019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:31.891839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab50b71-624c-4814-9cf5-465a923a4bdd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:31.947677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:32.009931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:32.010452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:32.010758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:32.011028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:32.012623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:32.102292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:32.104100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6086-79f1-47db-b4c8-097ebd4ae85d service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:32.121645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 691/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:34.191340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:34.191837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:34.191837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:34.193309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 686/1377] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:34.198760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a659e6-1cb1-4673-a90b-5ea4b8ea559a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:34.199179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a659e6-1cb1-4673-a90b-5ea4b8ea559a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:34.199295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a659e6-1cb1-4673-a90b-5ea4b8ea559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:34.263797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d8a659e6-1cb1-4673-a90b-5ea4b8ea559a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:34.264979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d8a659e6-1cb1-4673-a90b-5ea4b8ea559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:34.271537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:34.374569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 692/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:34.689193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:34.691791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:34.865841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12710505-ee87-4fc2-b61c-b5ee53480959 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:34.870262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:34.980292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:34.981054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:34.981425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:34.981788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:34.983531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:35.076305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:35.078069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e7afa-0335-4063-b529-938f00dafa73 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:35.097518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 687/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:37.226295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:37.227495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:37.227495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:37.228656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 693/1380] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:37.234019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57fb89-0101-4bcc-bdcf-ca311c58e307 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:37.234491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57fb89-0101-4bcc-bdcf-ca311c58e307 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:37.234622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57fb89-0101-4bcc-bdcf-ca311c58e307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:37.246190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:37.315292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-cd57fb89-0101-4bcc-bdcf-ca311c58e307 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:37.316063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cd57fb89-0101-4bcc-bdcf-ca311c58e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:37.419097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 688/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:37.717887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:37.719432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:37.866538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:37.878253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f5cf7-6a51-4780-b7b5-cc8dd449ce58 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:38.004203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:38.004757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:38.005038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:38.005314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:38.006980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:38.106163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:38.107768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e94d2f-b14c-4236-80ec-30b59bea4d1d service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:38.118899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:38.127800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 694/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:40.230707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.231271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.231401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.233228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 689/1383] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:40.238816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feaad9-0e3b-4b95-b567-892264f10427 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:40.239234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feaad9-0e3b-4b95-b567-892264f10427 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:40.239562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feaad9-0e3b-4b95-b567-892264f10427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:40.319356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d5feaad9-0e3b-4b95-b567-892264f10427 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:40.320629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5feaad9-0e3b-4b95-b567-892264f10427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:40.420995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 695/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:40.713707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:40.715338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:40.807226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:40.881383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41910-8a3d-49b4-b0e6-a0b1e299ccf1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:41.004425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:41.004986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:41.005275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:41.005557 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:41.007269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:41.060452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:41.100586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:41.102823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683df35-4b57-484a-a6ca-cb9a96a7cef0 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:41.122481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 690/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:43.036017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:43.036521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:43.036615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:43.037958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 696/1386] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:43.044432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23b0f-7786-44cb-b577-6435a7d3c612 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:43.044843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23b0f-7786-44cb-b577-6435a7d3c612 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:43.056770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23b0f-7786-44cb-b577-6435a7d3c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:43.113356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d9f23b0f-7786-44cb-b577-6435a7d3c612 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:43.114589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9f23b0f-7786-44cb-b577-6435a7d3c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:43.212299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 691/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:43.503982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:43.505554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:43.592655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:43.665898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64085-f737-494d-aa46-2a7d8fe95814 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:43.789772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:43.790499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:43.790807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:43.791079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:43.792694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:43.831930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:43.885509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:43.887382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a044a-a213-4789-b606-0c7c9717c2e1 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:43.907060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 697/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:45.969455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62b84-f296-4281-b8f8-e4f554dc1776 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:45.970014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62b84-f296-4281-b8f8-e4f554dc1776 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:45.970014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d62b84-f296-4281-b8f8-e4f554dc1776 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:45.971529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 692/1389] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:45.977319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23382c-4bc8-46cc-a51c-09adc79114e3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:45.977780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23382c-4bc8-46cc-a51c-09adc79114e3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:45.977935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23382c-4bc8-46cc-a51c-09adc79114e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.046059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6a23382c-4bc8-46cc-a51c-09adc79114e3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.047306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6a23382c-4bc8-46cc-a51c-09adc79114e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.145117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 698/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:46.334815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.335021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.335259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.337224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 693/1391] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:46.342262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2461d6-136e-40b7-83c0-b9e0d69bf5af None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.342574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2461d6-136e-40b7-83c0-b9e0d69bf5af None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.342852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2461d6-136e-40b7-83c0-b9e0d69bf5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.358316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:46.408038 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ab2461d6-136e-40b7-83c0-b9e0d69bf5af None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.409341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ab2461d6-136e-40b7-83c0-b9e0d69bf5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.433707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.435283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.467702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:46.512442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 699/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:46.582323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dcc22-ad16-483e-afd7-30abe08ca26a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:46.685433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:46.697543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:46.698179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.698457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.698769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.700410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.791676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:46.793268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9ebe-4826-43f4-b81d-c0fce8426d40 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:46.811548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.811833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.811936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 694/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:46.812141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.813389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 700/1394] 10.222.0.18 () {54 vars in 967 bytes} [Fri Aug 12 11:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:55:46.818494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454baf-b421-480d-80a2-790eaaec90f2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:46.818802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454baf-b421-480d-80a2-790eaaec90f2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:46.819097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5454baf-b421-480d-80a2-790eaaec90f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:46.898886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e5454baf-b421-480d-80a2-790eaaec90f2 None None] MFA Rules not processed for user `0fb6edf322d64dad81ac0bca7a1c32c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:46.900091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e5454baf-b421-480d-80a2-790eaaec90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:46.953283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:46.975900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 695/1395] 10.222.0.18 () {58 vars in 1064 bytes} [Fri Aug 12 11:55:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:46.983652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:46.985324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:47.096018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:47.103706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c7a0-f822-4304-b8d7-6672e9c55c82 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:47.177893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:47.178500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:47.178805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:47.179078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:47.181211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:47.289316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:47.290943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2343dc-bea3-44c6-be79-16ea84127152 service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:47.310081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 701/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:48.155570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7314-9e3a-40cf-884f-fb7cab2adc7e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.156075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7314-9e3a-40cf-884f-fb7cab2adc7e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.156158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7314-9e3a-40cf-884f-fb7cab2adc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.222796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-559f7314-9e3a-40cf-884f-fb7cab2adc7e None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:48.223980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-559f7314-9e3a-40cf-884f-fb7cab2adc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.309337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 696/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:48.356762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.357277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.357371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.358728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 702/1398] 10.222.0.18 () {54 vars in 943 bytes} [Fri Aug 12 11:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:48.365380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca94cd-e5b4-4ba8-9eb0-34e5700742e5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.365800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca94cd-e5b4-4ba8-9eb0-34e5700742e5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.366084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca94cd-e5b4-4ba8-9eb0-34e5700742e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.441796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bdca94cd-e5b4-4ba8-9eb0-34e5700742e5 None None] MFA Rules not processed for user `fae4b6d2e7f5478495814d5f392b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:48.442949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bdca94cd-e5b4-4ba8-9eb0-34e5700742e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.456495 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.550056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 697/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Fri Aug 12 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:48.559979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:48.561524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.584882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.695523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095f2d6-0f70-4754-9161-26b42984d741 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:48.803429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:48.804079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.804961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.805226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.807275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:48.818805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:48.905273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e31-bcd8-4287-8c57-c236494ac834 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.905550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e31-bcd8-4287-8c57-c236494ac834 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.905817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340e31-bcd8-4287-8c57-c236494ac834 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.906104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:48.907220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 698/1400] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 11:55:48.907736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:48.912099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515448-e08a-4847-9b0d-d8098ed9f028 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:48.912388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515448-e08a-4847-9b0d-d8098ed9f028 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:48.912687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515448-e08a-4847-9b0d-d8098ed9f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:48.916939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 703/1401] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 11:55:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 11:55:48.980124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-91515448-e08a-4847-9b0d-d8098ed9f028 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:48.981249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91515448-e08a-4847-9b0d-d8098ed9f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:49.054799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:49.078150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 699/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:55:49.372315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:49.373619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:49.470778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3dfab-cd70-47b6-9da6-dd8cb2678ced service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:49.528170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:49.590448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:49.591296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:49.591584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:49.591853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:49.593455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:49.696097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:49.697676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982fe67-e23d-4841-9608-65c8622bbb54 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:49.718397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 704/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:55:51.840616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.841170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.841170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.842534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 700/1404] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:51.847712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f626-f3db-424d-854b-3e79ed52d0ca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:51.848164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f626-f3db-424d-854b-3e79ed52d0ca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:51.848273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f626-f3db-424d-854b-3e79ed52d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:51.919776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c743f626-f3db-424d-854b-3e79ed52d0ca None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:51.921444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c743f626-f3db-424d-854b-3e79ed52d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:51.938871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:52.030596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 705/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:52.335381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:52.339063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:52.532481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a42af-c9e9-4b6e-8b7c-52ed60543db6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:52.601750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:52.673416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:52.674142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:52.674428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:52.674728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:52.676371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:52.789994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:52.791554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e9aba-c9a2-4e93-ba74-a0cc2693e5b8 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:52.813198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 701/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:55:54.995291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:54.995894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:54.995894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:54.997168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 706/1407] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:55:55.002391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0670-5b63-42c3-9614-c882607d5547 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:55.002920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0670-5b63-42c3-9614-c882607d5547 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:55.003023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0670-5b63-42c3-9614-c882607d5547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:55.084457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-095c0670-5b63-42c3-9614-c882607d5547 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:55:55.086214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-095c0670-5b63-42c3-9614-c882607d5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:55.105253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:55.193678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 702/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:55:55.493979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:55:55.495596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:55.653230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:55:55.655845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934232f-93d8-4dc1-9322-1171f1c65f9b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:55:55.780636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:55:55.781250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:55:55.781548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:55:55.781911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:55:55.783576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:55:55.883737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:55:55.885734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e6011-a996-47c6-8d5e-790bc2c94dba service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:55:55.905539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 707/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:05.191462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=35 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:05.902897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:12.355100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428367f-2015-49da-82ed-a07c39f59d15 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:12.355647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428367f-2015-49da-82ed-a07c39f59d15 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:12.355647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428367f-2015-49da-82ed-a07c39f59d15 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:12.356994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 703/1410] 10.222.0.18 () {54 vars in 918 bytes} [Fri Aug 12 11:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:12.362102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb00b9-3671-4109-98a1-b9e0ec7b62c2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:12.362603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb00b9-3671-4109-98a1-b9e0ec7b62c2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:12.362727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb00b9-3671-4109-98a1-b9e0ec7b62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:12.436231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f6bb00b9-3671-4109-98a1-b9e0ec7b62c2 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:12.437446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f6bb00b9-3671-4109-98a1-b9e0ec7b62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:12.544230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 708/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Aug 12 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:12.558865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0828-e151-41d5-a364-31cd002e050e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:12.559156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0828-e151-41d5-a364-31cd002e050e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:12.559435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0828-e151-41d5-a364-31cd002e050e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:12.560781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 704/1412] 10.222.0.18 () {54 vars in 918 bytes} [Fri Aug 12 11:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:12.565432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c34d-dc3a-43a6-9857-09c93562b4fb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:12.565745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c34d-dc3a-43a6-9857-09c93562b4fb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:12.566021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c34d-dc3a-43a6-9857-09c93562b4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:12.637694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:12.640165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a350c34d-dc3a-43a6-9857-09c93562b4fb None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:12.641368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a350c34d-dc3a-43a6-9857-09c93562b4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:12.755740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 709/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Aug 12 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:15.108130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:15.108673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:15.108673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:15.109995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:15.115302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59cd0-b0b3-4bf9-a1d8-c2d4ee928d7f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:15.115752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59cd0-b0b3-4bf9-a1d8-c2d4ee928d7f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:15.116471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd59cd0-b0b3-4bf9-a1d8-c2d4ee928d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:15.181752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7cd59cd0-b0b3-4bf9-a1d8-c2d4ee928d7f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:15.182989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7cd59cd0-b0b3-4bf9-a1d8-c2d4ee928d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:15.237965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:15.279364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:15.565455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:15.567005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:15.831921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365f14-0011-4053-a200-cc8715bd9c85 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:15.905822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:15.944813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:15.945414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:15.945685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:15.945950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:15.947560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:16.033510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:16.035139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e26d8b-741e-401c-812a-f71327cc003a service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:16.053019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 706/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:16.945662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994546-b697-4899-baaa-c93c5488295b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:16.946220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994546-b697-4899-baaa-c93c5488295b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:16.946220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994546-b697-4899-baaa-c93c5488295b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:16.947666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:16.952559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f820-0d12-4a50-a3a8-02eb994d3c65 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:16.952997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f820-0d12-4a50-a3a8-02eb994d3c65 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:16.953113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520f820-0d12-4a50-a3a8-02eb994d3c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:17.026623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d520f820-0d12-4a50-a3a8-02eb994d3c65 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:17.027815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d520f820-0d12-4a50-a3a8-02eb994d3c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:17.055122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:17.127326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:17.276066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994546-b697-4899-baaa-c93c5488295b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:17.277489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-75994546-b697-4899-baaa-c93c5488295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:17.420901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994546-b697-4899-baaa-c93c5488295b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:17.459148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:17.530899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:17.531429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:17.531699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:17.531964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:17.533539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:17.623311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:17.624860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc46-cc69-4108-adcf-456e6198c57c service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:17.642059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 712/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:18.531602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:18.532136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:18.532136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:18.533517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:18.538261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa0c8-a9a3-4e4b-bb81-bff32cb4424f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:18.538726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa0c8-a9a3-4e4b-bb81-bff32cb4424f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:18.538824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afa0c8-a9a3-4e4b-bb81-bff32cb4424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:18.593514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:18.614421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-42afa0c8-a9a3-4e4b-bb81-bff32cb4424f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:18.615654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-42afa0c8-a9a3-4e4b-bb81-bff32cb4424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:18.711063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:18.870531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:18.872076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:19.015320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a78d44-57c6-4906-abf3-e0532704a9df None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:19.026979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:19.128712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:19.129309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:19.129585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:19.129850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:19.132096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:19.245895 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:19.247493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69a6bf-69ff-44ea-98a3-050d7b879c3b service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:19.265556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 709/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:20.124806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:20.125349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:20.125349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:20.126690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:20.132140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd913-e349-4f22-a58e-d21e0cf92172 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:20.132596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd913-e349-4f22-a58e-d21e0cf92172 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:20.132696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dd913-e349-4f22-a58e-d21e0cf92172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:20.153929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:20.207930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-086dd913-e349-4f22-a58e-d21e0cf92172 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:20.209114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-086dd913-e349-4f22-a58e-d21e0cf92172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:20.303746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:20.455667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:20.457229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:20.564257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:20.599807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba316d3-eb2a-460d-b6aa-969a617ad006 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:20.708070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:20.708661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:20.708936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:20.709206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:20.710842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:20.784076 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:20.797565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:20.799398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d813f-f081-40f7-91d9-c63afc6d5817 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:20.817434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 715/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:21.668151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34737-a073-42e0-a205-684465adaebf None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:21.668686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34737-a073-42e0-a205-684465adaebf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:21.668686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34737-a073-42e0-a205-684465adaebf None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:21.670032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:21.675027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4088a3-b668-457f-b2c9-f045025e5cd7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:21.675454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4088a3-b668-457f-b2c9-f045025e5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:21.675571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4088a3-b668-457f-b2c9-f045025e5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:21.749965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad4088a3-b668-457f-b2c9-f045025e5cd7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:21.751111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad4088a3-b668-457f-b2c9-f045025e5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:21.845202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:21.994257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b34737-a073-42e0-a205-684465adaebf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:21.995779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-02b34737-a073-42e0-a205-684465adaebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:22.076735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:22.136728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b34737-a073-42e0-a205-684465adaebf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:22.247525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:22.248124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:22.248399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:22.248665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:22.250254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:22.298599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:22.341246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:22.342885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8156ea6-8e50-46b7-98a0-0eb3f681a6c1 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:22.360544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 712/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:23.246293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:23.246882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:23.246882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:23.248197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:23.253067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe274a1-1911-4d28-8db2-325c55b08978 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:23.253513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe274a1-1911-4d28-8db2-325c55b08978 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:23.253624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe274a1-1911-4d28-8db2-325c55b08978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:23.326686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9fe274a1-1911-4d28-8db2-325c55b08978 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:23.327793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9fe274a1-1911-4d28-8db2-325c55b08978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:23.422176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:23.577082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:23.578557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:23.626327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:23.723738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c58ede-aa8e-4bc0-9bda-278de8013008 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:23.837746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:23.838355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:23.838682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:23.838956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:23.840548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:23.847353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:23.929517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:23.931120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831294d7-2d44-4fcd-a17f-0a5f33233980 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:23.948383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 718/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:24.811951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:24.812484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:24.812484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:24.813733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:24.819713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cd0e2-cc44-4267-ae11-39b0c0deb789 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:24.820115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cd0e2-cc44-4267-ae11-39b0c0deb789 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:24.820245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cd0e2-cc44-4267-ae11-39b0c0deb789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:24.892952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7f8cd0e2-cc44-4267-ae11-39b0c0deb789 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:24.894141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7f8cd0e2-cc44-4267-ae11-39b0c0deb789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:24.959305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:24.986402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:25.137826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:25.139390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:25.158417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:25.280106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bcdb2-f112-4f03-b61a-c0bd7cca5e9c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:25.366748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:25.391603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:25.392134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:25.392405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:25.392667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:25.394333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:25.486130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:25.487750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bad2e-db8f-481c-bf7e-e161434fd65e service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:25.505709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 715/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:26.365738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354445-5d96-4781-960b-c964d176aa52 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:26.366395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354445-5d96-4781-960b-c964d176aa52 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:26.366395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354445-5d96-4781-960b-c964d176aa52 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:26.367618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:26.372617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b2bb-fc6c-4497-b76a-a39ea894fb46 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:26.373033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b2bb-fc6c-4497-b76a-a39ea894fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:26.373163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b2bb-fc6c-4497-b76a-a39ea894fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:26.448727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1d57b2bb-fc6c-4497-b76a-a39ea894fb46 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:26.449915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1d57b2bb-fc6c-4497-b76a-a39ea894fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:26.491637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:26.545294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:26.697803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354445-5d96-4781-960b-c964d176aa52 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:26.699283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-64354445-5d96-4781-960b-c964d176aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:26.844168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354445-5d96-4781-960b-c964d176aa52 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:26.897229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:26.954506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:26.955081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:26.955362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:26.955641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:26.957237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:27.045399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:27.046994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b5930-9ff7-4af8-82f8-16fa0401ed3c service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:27.065162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 721/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:27.925602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:27.926100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:27.926209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:27.927535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 11:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:27.932690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddde93-f02a-4876-bea4-7e1faa55d5d2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:27.933130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddde93-f02a-4876-bea4-7e1faa55d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:27.933232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddde93-f02a-4876-bea4-7e1faa55d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.005785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-07ddde93-f02a-4876-bea4-7e1faa55d5d2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:28.006995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-07ddde93-f02a-4876-bea4-7e1faa55d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.008969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:28.102930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:56:28.254624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:28.256627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.399146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e9bd5-9f2d-4b4e-ac56-72f5630328ff None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:28.426273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:28.512120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:28.512721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:28.512999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:28.513270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:28.514900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:28.602183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:28.603803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac8a25-8b32-4abe-bf72-43c1409c8889 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:28.621842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 718/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:30.440245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.440838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.440838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.442130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:30.448161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f0c4-e4af-4a25-8878-5537606f1d7a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:30.448594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f0c4-e4af-4a25-8878-5537606f1d7a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:30.448713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f0c4-e4af-4a25-8878-5537606f1d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:30.488180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:30.513343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9838f0c4-e4af-4a25-8878-5537606f1d7a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:30.514539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9838f0c4-e4af-4a25-8878-5537606f1d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:30.609297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:30.903679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:30.905253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.006529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8955158-fd41-45dc-b439-f9c30ac99596 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:31.041188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:31.080560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:31.081158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:31.081435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:31.081703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:31.083317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:31.191967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:31.193307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf1c29-123e-432b-9c3e-f8936ee49154 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:31.211903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 724/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:33.312134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:33.312666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:33.312666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:33.313925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:33.319077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1edef-124a-4e3c-90e0-b5ba21073429 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:33.319511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1edef-124a-4e3c-90e0-b5ba21073429 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:33.319619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1edef-124a-4e3c-90e0-b5ba21073429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:33.384288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cdd1edef-124a-4e3c-90e0-b5ba21073429 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:33.385513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cdd1edef-124a-4e3c-90e0-b5ba21073429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:33.397934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:33.480945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:33.764857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:33.769338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:33.867169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9776682-58cd-4955-bd73-b21b99dbd9ab None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:33.879132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:33.939226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:33.939819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:33.940095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:33.940361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:33.941938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:34.048047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:34.049403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840c54-40e4-41ba-9172-35a472521289 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:34.067494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 721/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:36.324667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:36.325247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:36.325359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:36.326653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:36.331888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e32c8-7b17-4c3c-bfaa-d9201a2ee329 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:36.332313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e32c8-7b17-4c3c-bfaa-d9201a2ee329 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:36.332422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e32c8-7b17-4c3c-bfaa-d9201a2ee329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:36.380588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:36.398199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-be7e32c8-7b17-4c3c-bfaa-d9201a2ee329 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:36.399411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-be7e32c8-7b17-4c3c-bfaa-d9201a2ee329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:36.492902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:36.775429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:36.776968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:36.881626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca23a5-b4b4-4843-93c7-d8a171c54002 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:36.925063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:36.958671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:36.959283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:36.959563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:36.959836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:36.961555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:37.078342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:37.079815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b011c-dad9-4d43-988c-4ea14e142c6d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:37.099536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 727/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:39.136584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.137110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.137110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.140165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:39.143671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983c86-177c-48d5-be67-a816e02bcca8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.144119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983c86-177c-48d5-be67-a816e02bcca8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.144225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983c86-177c-48d5-be67-a816e02bcca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.217470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-41983c86-177c-48d5-be67-a816e02bcca8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:39.218701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-41983c86-177c-48d5-be67-a816e02bcca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.239305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:39.314343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:39.602043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:39.603616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.704430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20c0f-8736-47a9-979b-a0435df9299b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:39.724021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:39.777404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:39.778220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:39.778496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:39.778795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:39.780598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:39.887604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:39.888950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f017eb-4292-44d7-bcab-660bbb100b41 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:39.907040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 724/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:41.859016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:41.859557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:41.859557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:41.860938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:41.866786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f729da-b5d9-469d-91dc-c20e39e6e49a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:41.867246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f729da-b5d9-469d-91dc-c20e39e6e49a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:41.867355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f729da-b5d9-469d-91dc-c20e39e6e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:41.929917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:41.932494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-18f729da-b5d9-469d-91dc-c20e39e6e49a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:41.933695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-18f729da-b5d9-469d-91dc-c20e39e6e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:42.026497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:42.314143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:42.315796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:42.418277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b885f-c27f-4ac9-8bc9-19bbab71484a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:42.466474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:42.491115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:42.491744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:42.492018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:42.492284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:42.493880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:42.601093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:42.602545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c822f-7e84-4ede-b51b-68fa74db8d54 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:42.620430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 730/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 11:56:44.564349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:44.564923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:44.564923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:44.566238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:44.571933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42fcb-fd42-4050-a92f-1d3c0972ad10 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:44.572379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42fcb-fd42-4050-a92f-1d3c0972ad10 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:44.572487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42fcb-fd42-4050-a92f-1d3c0972ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:44.636850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-94f42fcb-fd42-4050-a92f-1d3c0972ad10 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:44.638041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-94f42fcb-fd42-4050-a92f-1d3c0972ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:44.666359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:44.733011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:45.019464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:45.021151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:45.125029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05e917-f060-4c03-a8cf-8c421b5cb420 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:45.153375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:45.206883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:45.207497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:45.207775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:45.208043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:45.210188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:45.315821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:45.317168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30c0f-eaa9-4f41-914e-38ea1262ef39 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:45.335412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 727/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:47.293370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.293952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.293952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.295393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:47.300822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ebaa-b748-46f9-94d8-f65793546e80 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.301255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ebaa-b748-46f9-94d8-f65793546e80 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.301359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117ebaa-b748-46f9-94d8-f65793546e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.364675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e117ebaa-b748-46f9-94d8-f65793546e80 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:47.365851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e117ebaa-b748-46f9-94d8-f65793546e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.373844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.462567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:47.744388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:47.745959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:47.851773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e254-15fb-4e84-8fc7-8b6580f7addd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:47.906669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:47.925375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:47.925981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:47.926260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:47.926540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:47.928800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:48.033439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:48.034807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178028a4-83e6-4d2b-941a-cfbbd771090c service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:48.053885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 733/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:49.972788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.973322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.973322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:49.974707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:49.979944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf67d-bd58-4e75-b3e1-8e4d566a5543 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:49.980344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf67d-bd58-4e75-b3e1-8e4d566a5543 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:49.980494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf67d-bd58-4e75-b3e1-8e4d566a5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.046852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a6aaf67d-bd58-4e75-b3e1-8e4d566a5543 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:50.048046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a6aaf67d-bd58-4e75-b3e1-8e4d566a5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.086178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:50.143715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:50.428296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:50.429833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.532083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d4e9-69a0-4af3-81a1-82d518724767 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:50.569092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:50.604855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:50.605456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:50.605734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:50.606005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:50.607634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:50.713260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:50.714636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93d1a2-031d-4aca-9c54-ead2d8748fdf service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:50.733009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 730/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:52.682487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.683053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.683053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.684311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:52.689521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392087-5aa2-4338-929d-c3d151f1a517 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:52.689949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392087-5aa2-4338-929d-c3d151f1a517 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:52.690080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392087-5aa2-4338-929d-c3d151f1a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:52.754493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1d392087-5aa2-4338-929d-c3d151f1a517 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:52.755741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1d392087-5aa2-4338-929d-c3d151f1a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:52.774271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:52.851957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:53.134565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:53.136108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:53.235997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2331ef8-c9fd-4eb5-ac92-374a71fe4a62 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:53.301209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:53.307874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:53.308413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:53.308686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:53.308954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:53.310547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:53.416951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:53.418360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b305e10-6a06-4489-a789-bfbdec1cf549 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:53.436724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 736/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:56:55.349353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.349897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.349897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.351254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 11:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:56:55.356815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79be2-4786-49c3-95e5-5acf7d74a6f4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.357214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79be2-4786-49c3-95e5-5acf7d74a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.357365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79be2-4786-49c3-95e5-5acf7d74a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.424194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2fd79be2-4786-49c3-95e5-5acf7d74a6f4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:56:55.425417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2fd79be2-4786-49c3-95e5-5acf7d74a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.475769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:55.523651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 11:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:56:55.806611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:56:55.808167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:55.909264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb47259-9c28-4dc1-9ab3-0b5c26ec0cac None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:56:55.956364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:56:55.981825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:56:55.982438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:56:55.982742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:56:55.983016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:56:55.984611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:56:56.092291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:56:56.093710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673990e-849b-41c4-9959-3c641b282ec2 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:56:56.112086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 733/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:05.521830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=22 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:06.109830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=66 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:15.554378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4c7c-a5d5-4690-8754-578091cf2a94 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:15.554985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4c7c-a5d5-4690-8754-578091cf2a94 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:15.554985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4c7c-a5d5-4690-8754-578091cf2a94 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:15.556275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 738/1471] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:15.561519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f738-9ea7-4bb8-a999-598437c45fec None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:15.561924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f738-9ea7-4bb8-a999-598437c45fec None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:15.562067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f738-9ea7-4bb8-a999-598437c45fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:15.625938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7cf7f738-9ea7-4bb8-a999-598437c45fec None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:15.627163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7cf7f738-9ea7-4bb8-a999-598437c45fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:15.722209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 734/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:16.018251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:16.018587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:16.018863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:16.020233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 739/1473] 10.222.0.18 () {54 vars in 967 bytes} [Fri Aug 12 11:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:16.025053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6254-ce69-4c98-b678-98fd8557881d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:16.025340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6254-ce69-4c98-b678-98fd8557881d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:16.025619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f6254-ce69-4c98-b678-98fd8557881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:16.101214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-089f6254-ce69-4c98-b678-98fd8557881d None None] MFA Rules not processed for user `0fb6edf322d64dad81ac0bca7a1c32c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:16.102402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-089f6254-ce69-4c98-b678-98fd8557881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:16.122608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:16.177210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 735/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Fri Aug 12 11:57:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:16.184920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:16.186416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:16.287746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4c266-3f4b-42c0-9cb5-475ae7a9e6cf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:16.358853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:16.359448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:16.359722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:16.359989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:16.361556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:16.415148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:16.469098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:16.470512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f5efe-4ff7-4350-ac33-e1aaf39d2965 service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:16.489725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 740/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:18.516760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:18.517302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:18.517302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:18.518713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 736/1476] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:18.524819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b982-891c-4c5b-aa9b-4c7778471076 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:18.525223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b982-891c-4c5b-aa9b-4c7778471076 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:18.525401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b982-891c-4c5b-aa9b-4c7778471076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:18.590015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d984b982-891c-4c5b-aa9b-4c7778471076 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:18.591237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d984b982-891c-4c5b-aa9b-4c7778471076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:18.686401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 741/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:18.955617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:18.957174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:19.085591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec98bf-f851-4386-8fb6-acbb22cb59af None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:19.134012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:19.177857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:19.178453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:19.178753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:19.179020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:19.179651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:19.181357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:57:19.181357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 11:57:19.181357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 11:57:19.182508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ca566-20d2-4d29-974c-f418f2fdb0f6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:19.201576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 737/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Aug 12 11:57:18 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:57:21.107259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:21.107777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:21.107777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:21.109156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 742/1479] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:21.114622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d30c-4aeb-40d7-9ef9-3ff4872e6ba3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:21.115068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d30c-4aeb-40d7-9ef9-3ff4872e6ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:21.115170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5d30c-4aeb-40d7-9ef9-3ff4872e6ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:21.180922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-51c5d30c-4aeb-40d7-9ef9-3ff4872e6ba3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:21.182118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-51c5d30c-4aeb-40d7-9ef9-3ff4872e6ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:21.277252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 738/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:21.573533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:21.575107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:21.585078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:21.718440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7dca-3752-4c20-ad5c-61a4cf587fd3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:21.796347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:21.828189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:21.828792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:21.829101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:21.829374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:21.830993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:21.919127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:21.920692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e164dc-9465-403e-913b-438620f6c583 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:21.937975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 743/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:23.995522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:23.996085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:23.996085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:23.997386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 739/1482] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:24.002526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201e99-cbf9-4aa1-b198-b86027c0c2a0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.002941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201e99-cbf9-4aa1-b198-b86027c0c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.003093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201e99-cbf9-4aa1-b198-b86027c0c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.068265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-85201e99-cbf9-4aa1-b198-b86027c0c2a0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:24.069478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-85201e99-cbf9-4aa1-b198-b86027c0c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.114479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:24.165702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 744/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:24.450746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:24.452295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.475512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:24.554846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a144-5304-4ec1-b4ec-7167fed6b08f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:24.632375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:24.632983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:24.633263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:24.633535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:24.635177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:24.709210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:24.743358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:24.744788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f835123-c6cc-4564-a8f8-1a0c72a68a27 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:24.762045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 740/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:26.713748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:26.714311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:26.714311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:26.715645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 745/1485] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:26.720784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88856-6efd-4623-bba3-0fe269a964f0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:26.721201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88856-6efd-4623-bba3-0fe269a964f0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:26.721295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a88856-6efd-4623-bba3-0fe269a964f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:26.785581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-56a88856-6efd-4623-bba3-0fe269a964f0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:26.786784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-56a88856-6efd-4623-bba3-0fe269a964f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:26.880962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 741/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:27.180315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:27.181918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:27.283664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ccac4-d753-49f9-98a2-9c80b33bfc6c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:27.354089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:27.355887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:27.356492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:27.356770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:27.357041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:27.358666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:27.469322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:27.470772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df2698-471b-4d0c-a6fb-8cee543c383a service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:27.489305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 746/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:29.557211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:29.557776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:29.557776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:29.559130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 742/1488] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:29.564494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a815-36a4-4367-9280-2dc55ca9ae8b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:29.564898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a815-36a4-4367-9280-2dc55ca9ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:29.565037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a815-36a4-4367-9280-2dc55ca9ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:29.629555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7888a815-36a4-4367-9280-2dc55ca9ae8b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:29.630777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7888a815-36a4-4367-9280-2dc55ca9ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:29.682315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:29.726565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 747/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:30.018188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:30.019778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:30.055761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:30.122712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec1780-cc69-4bef-b48f-0f79a6ab3b49 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:30.196671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:30.197273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:30.197550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:30.197823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:30.199567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:30.279911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:30.310255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:30.311801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca301976-99b2-49bf-95c4-212f963478fc service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:30.330131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 743/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:32.557460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:32.558003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:32.558003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:32.559342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 748/1491] 10.222.0.18 () {54 vars in 927 bytes} [Fri Aug 12 11:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:57:32.564584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe284-9d02-4bde-8bdb-23efb0698da6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:32.564977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe284-9d02-4bde-8bdb-23efb0698da6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:32.565148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe284-9d02-4bde-8bdb-23efb0698da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:32.631230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-47ffe284-9d02-4bde-8bdb-23efb0698da6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:57:32.632423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47ffe284-9d02-4bde-8bdb-23efb0698da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:32.726097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 744/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Aug 12 11:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:57:33.014894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:57:33.016434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.118645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aeb6a-1c97-4733-92b9-0403373c5560 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:57:33.196859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:57:33.197461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:57:33.197738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:57:33.198008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:57:33.199641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:57:33.209371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:33.309304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:57:33.310662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd609b-81f3-4f36-93c0-6b50c3fa91d6 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:57:33.328060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 749/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:57:42.724430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=82 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:57:43.325807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=50 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:53.041648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:53.042250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:53.042250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:53.116635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:53.117826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:53.210044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 745/1494] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:53.217997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd72b-476d-472e-920d-98646a6791ca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:53.218500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd72b-476d-472e-920d-98646a6791ca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:53.218905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bd72b-476d-472e-920d-98646a6791ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:53.294266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-036bd72b-476d-472e-920d-98646a6791ca None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:53.295411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-036bd72b-476d-472e-920d-98646a6791ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:53.387888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 750/1495] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:53.392512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:53.393714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:53.405500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6fd7-1cb2-4d92-ae24-2ade4485b6c8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:53.466240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:53.499802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:53.500400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:53.500679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:53.500952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:53.501622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 11:58:53.501923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:53.502958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:53.502958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 11:58:53.502958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 11:58:53.503846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:53.515443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 746/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 11:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 11:58:53.523913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bd72b-476d-472e-920d-98646a6791ca None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:53.533060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bd72b-476d-472e-920d-98646a6791ca None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:53.595166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:53.628220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:53.628827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:53.629128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:53.629377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:53.630001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:53.632620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:53.632620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 11:58:53.632620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 11:58:53.633821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:53.772533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 751/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 11:58:53 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:53.776668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:53.778216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:53.813290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9f5f-a838-4a6e-8257-a6ffa8c6643a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:53.902975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:53.903573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:53.903846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:53.904112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:53.904719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:53.905715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:53.905715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 11:58:53.905715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 11:58:53.906933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:54.000864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 747/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 11:58:53 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 11:58:54.007052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:54.008570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.069410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8064b2-0cea-4fc2-9570-26e2a37d77e7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:54.151530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:54.161663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:54.162846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.163128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.163402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.164044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:54.165070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:54.165070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 11:58:54.165070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 11:58:54.165935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:54.178326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 752/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 11:58:54.182377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:54.183932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.195348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7fc7d-69e6-41b1-8bd1-9634acd56bbd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:54.220134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:54.293101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:54.293707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.293984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.294255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.294929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:54.295936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:54.295936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 11:58:54.295936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 11:58:54.296817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a3d-c8cd-4a47-a7c2-5594be7a5235 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:54.309006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 748/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 11:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 11:58:54.313334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:54.314901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.349131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39736c9-045f-49fc-b3d0-23a5282a2bad admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:54.440930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:54.441518 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.441797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.442069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] PATH_INFO: `/v3/projects/c1c432c7c71b4b51a25724de72a2083d/users/787aa4d66ce644508f0e20f7b5fdceed/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.464366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c432c7c71b4b51a25724de72a2083d, user_id=787aa4d66ce644508f0e20f7b5fdceed, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:54.465393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:54.465393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 11:58:54.465393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 11:58:54.467349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703b9d-5201-4e07-b8ea-80fd077dee5d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:54.594361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 753/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 11:58:54 2022] PUT /identity/v3/projects/c1c432c7c71b4b51a25724de72a2083d/users/787aa4d66ce644508f0e20f7b5fdceed/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 11:58:54.606607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0724a-d042-495a-94ec-5eb138ae40ee None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.606896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0724a-d042-495a-94ec-5eb138ae40ee None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.607170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0724a-d042-495a-94ec-5eb138ae40ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.662838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-87a0724a-d042-495a-94ec-5eb138ae40ee None None] MFA Rules not processed for user `787aa4d66ce644508f0e20f7b5fdceed`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:54.664063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-87a0724a-d042-495a-94ec-5eb138ae40ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.740130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 749/1502] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 11:58:54.753248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.753570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.753846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.755256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 754/1503] 10.222.0.18 () {54 vars in 964 bytes} [Fri Aug 12 11:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:58:54.760658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aab6a-f1b0-4039-8842-39bd945e9e70 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:54.760943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aab6a-f1b0-4039-8842-39bd945e9e70 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:54.761212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aab6a-f1b0-4039-8842-39bd945e9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:54.791837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:54.836957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-139aab6a-f1b0-4039-8842-39bd945e9e70 None None] MFA Rules not processed for user `971fc696d71f4812bf3e50bafb3871a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:54.838154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-139aab6a-f1b0-4039-8842-39bd945e9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.912878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 750/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Aug 12 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:54.921056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:54.922590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:54.971819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:55.024818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837208-955e-491a-9ef1-a311f8bf84c1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:55.098940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:55.099544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.099817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.100083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.101741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:55.203030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:55.204496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:55.207982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:55.222017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 755/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:55.266472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea24a6-e4ae-4580-95b1-419782d97d18 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.266919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea24a6-e4ae-4580-95b1-419782d97d18 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.267055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea24a6-e4ae-4580-95b1-419782d97d18 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.268310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 751/1506] 10.222.0.18 () {52 vars in 830 bytes} [Fri Aug 12 11:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 11:58:55.271895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:55.273105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:55.371581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685498-3438-4e19-b8b1-db1077f30043 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:55.464436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:55.465075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.465350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.465617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] PATH_INFO: `/v3/users/787aa4d66ce644508f0e20f7b5fdceed` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.478908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] RBAC: Authorizing `identity:delete_user(user_id=787aa4d66ce644508f0e20f7b5fdceed)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:55.479915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:55.479915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 11:58:55.479915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 11:58:55.481098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:55.491324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:55.692614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787aa4d66ce644508f0e20f7b5fdceed'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.787778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787aa4d66ce644508f0e20f7b5fdceed'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.813085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787aa4d66ce644508f0e20f7b5fdceed'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.826588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787aa4d66ce644508f0e20f7b5fdceed'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.827056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787aa4d66ce644508f0e20f7b5fdceed'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:55.832591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 756/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 11:58:55 2022] DELETE /identity/v3/users/787aa4d66ce644508f0e20f7b5fdceed => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:58:55.837683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:55.837965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:55.838234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:55.893148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 11:58:55.894369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:55.967378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:55.979898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 752/1508] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 11:58:55.989635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:55.990877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.091907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c7aa-064e-4c6e-89ff-4fc9e391205a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.145713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:58:56.165343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.165945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.166218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.166485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.168359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.274986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.276319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfebb-371a-4f00-a8b4-3c5292d8a8aa service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.294939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 757/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:58:56.733498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:58:56.736351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:58:56.746737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f3d8-19b2-43f0-815a-5521e462e912 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:58:56.843894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:58:56.844519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:58:56.844794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:58:56.845057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] PATH_INFO: `/v3/projects/c1c432c7c71b4b51a25724de72a2083d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:58:56.855301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c432c7c71b4b51a25724de72a2083d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:58:56.856317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 11:58:56.856317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 11:58:56.856317 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 11:58:56.857486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:58:56.989729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c432c7c71b4b51a25724de72a2083d', 'request_id': 'req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.003055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c432c7c71b4b51a25724de72a2083d', 'request_id': 'req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.056581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c432c7c71b4b51a25724de72a2083d', 'request_id': 'req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.078650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] The token cache is being invalidate because project c1c432c7c71b4b51a25724de72a2083d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 11:58:57.078930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.079447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f72a4b20-4bd7-42d7-957c-1f31bc97d4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 11:58:57.080754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 753/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 11:58:56 2022] DELETE /identity/v3/projects/c1c432c7c71b4b51a25724de72a2083d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:59:06.292389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=62 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:59:07.076776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:26.835565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:26.836130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:26.836130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:26.837390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 12:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:26.842727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926f82-9bdc-4889-928e-fc6bb28e9f1b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:26.843175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926f82-9bdc-4889-928e-fc6bb28e9f1b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:26.843309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926f82-9bdc-4889-928e-fc6bb28e9f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:26.922413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1f926f82-9bdc-4889-928e-fc6bb28e9f1b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:26.923626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f926f82-9bdc-4889-928e-fc6bb28e9f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:27.024558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:27.178110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:27.180274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:27.296582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818b88-69fb-41dc-b034-c7d131e2aee5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:27.302184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:27.302821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:27.303098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:27.303367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:27.311197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:27.312779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816f363-bf9f-4dbc-8bb1-bda790cc353d service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:27.321922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 759/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:28.155978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee464ce-b875-4cce-9ced-1c9fbb9a7e15 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:28.156521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee464ce-b875-4cce-9ced-1c9fbb9a7e15 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:28.156521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee464ce-b875-4cce-9ced-1c9fbb9a7e15 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:28.157875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 12:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:28.162541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd009fe9-a2fa-41fd-9f5c-f0cb49f29541 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:28.162996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd009fe9-a2fa-41fd-9f5c-f0cb49f29541 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:28.163101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd009fe9-a2fa-41fd-9f5c-f0cb49f29541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:28.183057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fd009fe9-a2fa-41fd-9f5c-f0cb49f29541 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:28.184271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fd009fe9-a2fa-41fd-9f5c-f0cb49f29541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:28.192182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:28.344540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee464ce-b875-4cce-9ced-1c9fbb9a7e15 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:28.358473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee464ce-b875-4cce-9ced-1c9fbb9a7e15 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:28.363781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:28.364370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:28.364647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:28.364916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:28.373321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:28.374933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c0cdf-a521-4f2d-8f59-abc3ff4cacaf service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:28.385452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 756/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:28.541439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001b69-e4f9-47eb-9694-3790181c36ce None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:28.541761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001b69-e4f9-47eb-9694-3790181c36ce None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:28.542571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001b69-e4f9-47eb-9694-3790181c36ce None None] PATH_INFO: `/v3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:28.543845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 761/1517] 10.222.0.30 () {54 vars in 925 bytes} [Fri Aug 12 12:00:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:00:28.551248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ee20-bc00-4e4c-a08e-4000238eaad2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:28.551540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ee20-bc00-4e4c-a08e-4000238eaad2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:28.551819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39ee20-bc00-4e4c-a08e-4000238eaad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:28.610250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6a39ee20-bc00-4e4c-a08e-4000238eaad2 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:28.611513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6a39ee20-bc00-4e4c-a08e-4000238eaad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:28.628770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:28.681993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 757/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Aug 12 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:37.738619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e2b8b-c3af-4df7-9fbc-c08d1e763b44 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:37.739182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e2b8b-c3af-4df7-9fbc-c08d1e763b44 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:37.739182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e2b8b-c3af-4df7-9fbc-c08d1e763b44 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:37.740404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 762/1519] 10.222.0.18 () {54 vars in 961 bytes} [Fri Aug 12 12:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:37.745542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12189-8da0-46b9-a4d7-ae2df64c75db None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:37.746006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12189-8da0-46b9-a4d7-ae2df64c75db None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:37.746111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12189-8da0-46b9-a4d7-ae2df64c75db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:37.765653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-47a12189-8da0-46b9-a4d7-ae2df64c75db None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:37.766853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47a12189-8da0-46b9-a4d7-ae2df64c75db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:37.775063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 758/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Aug 12 12:00:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:37.782391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e2b8b-c3af-4df7-9fbc-c08d1e763b44 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:37.795919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e2b8b-c3af-4df7-9fbc-c08d1e763b44 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:37.801623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:37.801623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:37.801876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:37.802146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:37.810830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:37.812407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c79b2-459b-4c06-b06a-9dbb162f8c1a service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:37.821775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 763/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:39.612390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256a22-ff93-4338-9ffc-94e40e987018 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:39.612949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256a22-ff93-4338-9ffc-94e40e987018 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:39.612949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256a22-ff93-4338-9ffc-94e40e987018 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:39.614278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 12:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:39.619199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496af03-8f1d-4d42-a83b-f1a87160728d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:39.623459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496af03-8f1d-4d42-a83b-f1a87160728d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:39.623459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496af03-8f1d-4d42-a83b-f1a87160728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:39.638775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d496af03-8f1d-4d42-a83b-f1a87160728d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:39.639951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d496af03-8f1d-4d42-a83b-f1a87160728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:39.647568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:39.798649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256a22-ff93-4338-9ffc-94e40e987018 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:39.813202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256a22-ff93-4338-9ffc-94e40e987018 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:39.819257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:39.819850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:39.820123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:39.820389 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:39.829144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:39.834785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f34e2-480b-46b6-9317-dc808174db11 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:39.841334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 760/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:40.654583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6cdb-e4f5-4eb6-85ff-d44c9c0dfeb0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:40.655149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6cdb-e4f5-4eb6-85ff-d44c9c0dfeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:40.655149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe6cdb-e4f5-4eb6-85ff-d44c9c0dfeb0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:40.656500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 12:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:40.661172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51d75-a05c-41b3-96e7-15496634a1ea None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:40.661625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51d75-a05c-41b3-96e7-15496634a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:40.661757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51d75-a05c-41b3-96e7-15496634a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:40.680886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-def51d75-a05c-41b3-96e7-15496634a1ea None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:40.682085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-def51d75-a05c-41b3-96e7-15496634a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:40.689900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:40.847554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe6cdb-e4f5-4eb6-85ff-d44c9c0dfeb0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:40.861621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe6cdb-e4f5-4eb6-85ff-d44c9c0dfeb0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:40.866937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:40.867524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:40.867803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:40.868075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:40.876522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:40.878072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be560e1c-903d-40af-b6b6-8ac57b0b057a service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:40.887878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 766/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:44.618014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:44.625615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:44.625615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:44.625615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 12:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:44.625872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772ea6-5908-477e-bfc4-a11534bd0414 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:44.626251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772ea6-5908-477e-bfc4-a11534bd0414 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:44.626251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91772ea6-5908-477e-bfc4-a11534bd0414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:44.646524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-91772ea6-5908-477e-bfc4-a11534bd0414 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:44.647735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-91772ea6-5908-477e-bfc4-a11534bd0414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:44.655751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:44.940744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:44.942443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:45.017967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c696-e41b-42f6-96e3-fa979538c147 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:45.021473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:45.022057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:45.022331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:45.022625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:45.031777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:45.033185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f304b0-fb02-4999-9234-b333d4545fa5 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:45.042177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 763/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:46.959297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8698d-6611-406c-9a6c-bb49dcb54782 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:46.959865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8698d-6611-406c-9a6c-bb49dcb54782 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:46.959865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8698d-6611-406c-9a6c-bb49dcb54782 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:46.961220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 12:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:46.966399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991028-a212-4161-ab29-8ecda58f90b4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:46.966875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991028-a212-4161-ab29-8ecda58f90b4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:46.967010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c991028-a212-4161-ab29-8ecda58f90b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:46.991152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c991028-a212-4161-ab29-8ecda58f90b4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:46.992368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c991028-a212-4161-ab29-8ecda58f90b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:47.000704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 12:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:47.287156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8698d-6611-406c-9a6c-bb49dcb54782 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:47.298742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8698d-6611-406c-9a6c-bb49dcb54782 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:47.302207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:47.302847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:47.303126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:47.303398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:47.312556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:47.313962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6b362-e34f-49d1-8c78-8dcbf84224d2 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:47.323067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 769/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:50.617705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:50.618263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:50.618263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:50.619638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 12:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:50.625301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750faa11-1261-41ac-b390-194d1b0c801e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:50.625709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750faa11-1261-41ac-b390-194d1b0c801e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:50.625849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750faa11-1261-41ac-b390-194d1b0c801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:50.645192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-750faa11-1261-41ac-b390-194d1b0c801e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:50.646389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-750faa11-1261-41ac-b390-194d1b0c801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:50.654056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:51.201339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:51.203018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:51.268560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:00:51.281604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbeff-86b7-4cc3-9f6f-2acbb624b9ad None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:51.285209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:51.285805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:51.286089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:51.286362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:51.295747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:51.297787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee7f79-590a-47ce-9a66-718feaca2907 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:51.308019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 766/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:00:53.252287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:53.252826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:53.252826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:53.254132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 12:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:00:53.259552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd323-0952-4156-8dcf-cf3cd56d5112 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:53.259955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd323-0952-4156-8dcf-cf3cd56d5112 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:53.260104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd323-0952-4156-8dcf-cf3cd56d5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:53.279805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0ddcd323-0952-4156-8dcf-cf3cd56d5112 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:00:53.280991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0ddcd323-0952-4156-8dcf-cf3cd56d5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:53.288735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:00:53.843241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:00:53.844931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:00:53.858493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9e3c-b454-4bdb-937c-b48be1a23633 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:00:53.861956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:00:53.862563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:00:53.862838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:00:53.863106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:00:53.871933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:00:53.873323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0889d8-4c12-42f3-831d-0e12e04043ad service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:00:53.882427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 772/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:01:03.275082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=11 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:01:03.878368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:18.516550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f9bb-beb1-4b27-af30-8fa4e3b82be9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.519720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f9bb-beb1-4b27-af30-8fa4e3b82be9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.519720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f9bb-beb1-4b27-af30-8fa4e3b82be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.521478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667145-bb95-4f6c-8f1d-dd1a1794606c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.521943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667145-bb95-4f6c-8f1d-dd1a1794606c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.522037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667145-bb95-4f6c-8f1d-dd1a1794606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.547275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fb25f9bb-beb1-4b27-af30-8fa4e3b82be9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.548523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fb25f9bb-beb1-4b27-af30-8fa4e3b82be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.561628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9d667145-bb95-4f6c-8f1d-dd1a1794606c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.563279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9d667145-bb95-4f6c-8f1d-dd1a1794606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.565260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 768/1540] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:18.566580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efa4-ed23-4a4f-9b98-5dc2b4dcc1a9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.566881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efa4-ed23-4a4f-9b98-5dc2b4dcc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.567148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efa4-ed23-4a4f-9b98-5dc2b4dcc1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.581657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 773/1541] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 12 12:02:18.583118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6cc27-f00f-4a84-b072-7e772cf8ebeb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.583573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6cc27-f00f-4a84-b072-7e772cf8ebeb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.583853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6cc27-f00f-4a84-b072-7e772cf8ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.603587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-be85efa4-ed23-4a4f-9b98-5dc2b4dcc1a9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.604862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-be85efa4-ed23-4a4f-9b98-5dc2b4dcc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.616764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-acb6cc27-f00f-4a84-b072-7e772cf8ebeb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.617990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-acb6cc27-f00f-4a84-b072-7e772cf8ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.618246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 769/1542] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.619543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330c1fa-5dd0-4279-9b6d-a895ea4dbc9c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.619830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330c1fa-5dd0-4279-9b6d-a895ea4dbc9c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.620104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330c1fa-5dd0-4279-9b6d-a895ea4dbc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.630370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 774/1543] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.635735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.636797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.639066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.671749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7330c1fa-5dd0-4279-9b6d-a895ea4dbc9c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.673208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7330c1fa-5dd0-4279-9b6d-a895ea4dbc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.677138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.678429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.702590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 775/1544] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.703347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 770/1545] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.703660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:18.704791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.705079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.705351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.721656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6e37a-79b2-41b4-87dd-101014fe494a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:18.735485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:18.736115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.736397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.736660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.737331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:18.738030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:18.744234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:18.744234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 12:02:18.744234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 12:02:18.745171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:18.750095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.751391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.766884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 776/1546] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:18.769288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:18.770399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 771/1547] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.771252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:18.787734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed603ff-ab50-4a13-9d05-3d9d503e32b0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:18.790797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547aa73-7616-46f6-a6e5-a5b8001ff969 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:18.798917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:18.799778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.800565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:18.801172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.801445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.801716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.802366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:18.802689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:18.804271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b737e-4861-4577-afcf-cf2a1a53221f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:18.806029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.806302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.806989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:18.807293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:18.810511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:18.824033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 777/1548] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:18.826256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c33c-6a63-46a0-92cc-58d5e7bee1d2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.827013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c33c-6a63-46a0-92cc-58d5e7bee1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.827506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c33c-6a63-46a0-92cc-58d5e7bee1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.837640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 772/1549] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:18.842438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:18.859605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0a40-c3e2-422a-8c6b-b649be2a5bbd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:18.862723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fea4c33c-6a63-46a0-92cc-58d5e7bee1d2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.864324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fea4c33c-6a63-46a0-92cc-58d5e7bee1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.865201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:18.865882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.866374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.866784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.867421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:18.868439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:18.868439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 12:02:18.868439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 12:02:18.869725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:18.873754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 778/1550] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.874816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.875102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.875451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.896266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:18.897689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:18.906171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 779/1551] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:18.906994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:18.917028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1f7d9-9cc4-4b89-9877-e4b6416fa458 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:18.922271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:18.922946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:18.923295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:18.923562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:18.924313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:18.926599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3c006-7772-42b8-aa97-1eb0f485e26f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:18.972253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 773/1552] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:18.972993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.044996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 780/1553] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.044996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36feb6-375f-446f-90fe-c971cc488a9c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.044996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36feb6-375f-446f-90fe-c971cc488a9c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.044996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36feb6-375f-446f-90fe-c971cc488a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.051101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225f3b6-907d-497f-b2f6-d1bab2f917bf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.065094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cf36feb6-375f-446f-90fe-c971cc488a9c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.066282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cf36feb6-375f-446f-90fe-c971cc488a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.107597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.108211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.108530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.108805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.109433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.111365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a376d91-e7ba-4a9d-a33f-46d4a0d03db9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.130552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 781/1554] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.130552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa59a5-58af-4c54-b5b0-5eb32f4c2ba9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.130552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa59a5-58af-4c54-b5b0-5eb32f4c2ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.130552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa59a5-58af-4c54-b5b0-5eb32f4c2ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.145014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-79fa59a5-58af-4c54-b5b0-5eb32f4c2ba9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.146227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-79fa59a5-58af-4c54-b5b0-5eb32f4c2ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.154907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 782/1555] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.156074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.156356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.156632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.176644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.177833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.185650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 783/1556] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.186406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.195354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10b324-ce35-4423-b47b-9438471f5f2d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.200226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.200813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.201089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.201362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.202004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:19.202307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.203924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.207356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 774/1557] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:18 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.207356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.207356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.207356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.218402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 784/1558] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:19.228597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.228728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.228728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.228992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c363-d864-4b98-8f8b-7c9f96b5ab59 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.249111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:19.277541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:19.286312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.287022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.287298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.287569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.288187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.289189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:19.289189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 12:02:19.289189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 12:02:19.290372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36275737-2ded-4053-b5a4-1630de2038f1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.291512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 775/1559] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.292986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.304339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f75663-9b9b-46c1-9e7f-894eecfab04c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.309193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.309830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.310109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.310388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.311042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.312952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e72753-1a52-4026-9edc-e8a7481ca464 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.405598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 785/1560] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.407031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.407321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.407596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.420121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 776/1561] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.420121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.420121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.420121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.427990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.429195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.440879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 786/1562] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.441060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.441194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.441303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.447574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41459f39-8ade-4d68-93df-b70758ce2f13 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.449023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 777/1563] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.449831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.456492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.457116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.457397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.457673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.458335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:19.458742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.461578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979d347-55d3-487e-b881-f2e83ac745aa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.461691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.466621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.467108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.467390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.467736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.468369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.470276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c02b-a313-40ae-a111-655a9c29d2a9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.480967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 787/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:19.480967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.487397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d78a-c5c9-4ab6-847b-b74f96dbdf81 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.491990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.495055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.495055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.495055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.495055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.495680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.545127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 778/1565] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.546431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.546825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.547166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.566537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:19.567720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:19.575928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 779/1566] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:19.576671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.585722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6a25-ddb5-4f3a-a081-1811e0084c86 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.595377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.595377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.595377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.595377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.595777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.595777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.604203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 780/1567] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:19.605047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.614259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e151597-60f5-4b8f-a2b3-000a9eaa0ed9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.618872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.619428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.619704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.619973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.620589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.622116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.624162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 788/1568] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:19.631834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.632113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 781/1569] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:19.632936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.642966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc0aae-c97f-4b2a-8ac2-d8fb5f40d1be admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.689732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaad3f-a7e8-48aa-89c2-c66826e6b72b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.694438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.695218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.695565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.695913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.696694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:19.697002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.697266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.697878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.698159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.698959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.699431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.699596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:19.699899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.701451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.710873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 789/1570] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:19.711644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.713230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 782/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:19.713961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.728219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e6ece-0332-47ae-94dc-5316c756507a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.728397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3234a9-d0a6-4e82-a967-095f774da424 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.732868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.733102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.733392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.733670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.733766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.733937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.734033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.734226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.734589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.734877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.736166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.736744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.748905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 783/1572] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:19.748905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.757752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2bdc-3559-4ba7-b22f-c1367125ee17 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.762878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.763443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.763715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.763983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.764676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:19.764976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.766542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.778361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 784/1573] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:19.779176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.789743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e36cf-862c-41b7-a246-24e5f6412012 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.794194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.794771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.795046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.795316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.795921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.797427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.807060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 785/1574] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:19.809357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:19.816512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a9622-11a9-4a7e-9825-d9029bd02a59 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:19.820835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:19.821361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:19.821635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:19.821904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:19.822485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:19.824884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:19.834689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:20.027530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 786/1575] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.027530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.027799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 790/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:19 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.027799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.037900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77fb5-61e0-48b5-9825-9f02174634c7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.094935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596d2ef-0892-4bda-b100-7c40704f55e3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.099483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.104865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.104865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.104865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.105153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.105261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.105441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.105441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.105441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.105441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.105769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.105866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.115118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 787/1577] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:20.116005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.126003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376abd-f503-4222-b337-e7f2a1b9567d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.130511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.131139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.131414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.131691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.132290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.134164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.191128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:20.201331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 791/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.201331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.240745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 788/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.240745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.260014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e6-e955-4bf8-8bcc-aed38070d2c8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.302182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cf17-beb1-4d8e-8ca4-1ad19fc38894 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.306913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.307509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.307851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.308683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.309307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.311225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.316449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.317058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.317339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.317609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.318242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.319874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.329857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 792/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:20.330716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.339926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d381f56-f5f9-402d-b5e2-9fa6a147a0f4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.344538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.345154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.345428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.345703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] PATH_INFO: `/v3/projects/6f54e9091b774d80816c5db6634c96b7/users/a52c9e7a702b4e51b6bc3fb7334db61f/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.360593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f54e9091b774d80816c5db6634c96b7, user_id=a52c9e7a702b4e51b6bc3fb7334db61f, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.363258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.386543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 789/1581] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.387492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.437699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:20.447665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b80e-44d3-46fb-956d-e0914c627172 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.448313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 793/1582] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:20 2022] PUT /identity/v3/projects/6f54e9091b774d80816c5db6634c96b7/users/a52c9e7a702b4e51b6bc3fb7334db61f/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:20.449411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.506605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.507220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.507500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.507771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.508413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.510032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.516056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412e14-fc45-49a4-adcf-ab43d31eb35e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.520220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 790/1583] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:20.520921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.521096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.521526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.521804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.522077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.522728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.524700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.531267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387c7fe-fb7d-4734-8ef4-000595fc5e62 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.535871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.536506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.536785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.537053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] PATH_INFO: `/v3/projects/103d85c375c0489dbef0497c3c41b686/users/601eeaeae5024d48a762049ecbc3bd0a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.552347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103d85c375c0489dbef0497c3c41b686, user_id=601eeaeae5024d48a762049ecbc3bd0a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.553307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:20.553307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 12:02:20.553307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 12:02:20.555286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.622508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 794/1584] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.623460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.632822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5bca9-1d41-46e5-a02c-0690dc1e96b3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.637461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.637998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.638337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.638573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.639178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.641045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.644819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 791/1585] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:20 2022] PUT /identity/v3/projects/103d85c375c0489dbef0497c3c41b686/users/601eeaeae5024d48a762049ecbc3bd0a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:20.645618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.649075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:20.708785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd238a9-27b2-4ff6-8ec0-7c4b888c2961 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.713423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.714623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.714905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.715177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.715824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.717770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.736540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 795/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.737643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.746925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71ed63-959a-4d2c-bc3b-c98c0be00f79 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.751453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.754058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.754058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.754058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] PATH_INFO: `/v3/projects/8c2559da5d6e4a58b6beaa5ed16054ad/users/c8da9964c697450eb7b3bef2620b130e/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.766792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2559da5d6e4a58b6beaa5ed16054ad, user_id=c8da9964c697450eb7b3bef2620b130e, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.769417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca392e-18be-4b5b-8d7e-3de65ab098f6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.845357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 792/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.846192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.856192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c183b-7cb8-4e7e-a9d3-8f8105c6ace9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.860776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.861344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.861626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.861896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.862507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.864444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.867706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 796/1588] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:20 2022] PUT /identity/v3/projects/8c2559da5d6e4a58b6beaa5ed16054ad/users/c8da9964c697450eb7b3bef2620b130e/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:20.868929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a222-7fef-401a-bb83-215414239198 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.869211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a222-7fef-401a-bb83-215414239198 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.869498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a222-7fef-401a-bb83-215414239198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.889948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-91e3a222-7fef-401a-bb83-215414239198 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:20.891180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-91e3a222-7fef-401a-bb83-215414239198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:20.948450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 797/1589] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:20.949283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a222-7fef-401a-bb83-215414239198 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.950829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 793/1590] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:20.951735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.959600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a222-7fef-401a-bb83-215414239198 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.962639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d65c-867a-40db-bbc9-88bfbb55317e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.964824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.965430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.965708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.966002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.966671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.967983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.968241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38c478-d990-45c7-86d2-b3c138fa0506 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.968576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.968852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.969177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.969851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:20.971668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:20.978048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 798/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:20.979293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.979539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.980392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.983334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 794/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:20.984066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:20.993350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2dc38-1c30-4c7f-ae5d-3ed4977508d7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:20.997975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:20.998563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:20.998799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:20.998923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:20.999099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:20.999720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.000001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.001270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1363-b871-4fa9-aa6b-7f2a602179b3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.007588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 799/1593] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.008355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.014572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 795/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.015825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.016110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.016382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.020983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80633b-6332-4c81-82d7-88171d144499 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.025584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.026178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.026456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.027323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.027970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.029553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.042287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 800/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.042287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.045529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] MFA Rules not processed for user `c8da9964c697450eb7b3bef2620b130e`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.046838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.049864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398dac-0d78-4deb-be5e-ee51a321c72b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.054548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.055142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.055421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.055705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.056320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.056569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:21.057893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.067462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 801/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.074176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.074176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.113790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 796/1597] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.114567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.127351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9ea2-b772-45a3-bd3f-130dcbe16a7c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.133195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a695e-ab4e-44d1-9c98-8e621fd165d1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.133685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.134594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.134882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.135160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] PATH_INFO: `/v3/projects/8c2189fee4104db6a92e920bfe256b0e/users/484d1b3c58834adcb10a32c410f9c986/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.138116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.138755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.139042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.139389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.149201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.150651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.153263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2189fee4104db6a92e920bfe256b0e, user_id=484d1b3c58834adcb10a32c410f9c986, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.156970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.161386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 802/1598] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:21.162281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.171857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237bb81-289e-4c25-b733-0aa7db6d394b service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.176880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.177477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.177826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.178031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.178835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.180419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.190254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 803/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.191069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.200869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a723a-35cd-4ba9-bf86-ba5e665496af admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.206697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.206697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.206697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.206697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.207132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.208665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.218638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 804/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.219390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.228063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc54f42-5379-406a-83a5-ac76a7344f8e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.231660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.232208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.232489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.232765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.238573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:21.242134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.243664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.252980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 805/1601] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:21.253742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.259784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 797/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:21 2022] PUT /identity/v3/projects/8c2189fee4104db6a92e920bfe256b0e/users/484d1b3c58834adcb10a32c410f9c986/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:21.264430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.267048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144342c-9e1b-4344-ae59-916ead4992b0 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.330703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.331194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e279ad-d2d0-466d-a4f3-a9a8fb2870a3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.331641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.331998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.332374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.333187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.334988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd02660-66cf-4f8f-b341-66f48e5fe6ca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.335861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.336473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.336755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.337032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.337684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.339907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.349812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 806/1603] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.349812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff111368-349d-47ab-b424-85d526032b6f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.349812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff111368-349d-47ab-b424-85d526032b6f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.349812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff111368-349d-47ab-b424-85d526032b6f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.353318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 798/1604] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:21.354049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.355131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 807/1605] 10.222.0.18 () {54 vars in 962 bytes} [Fri Aug 12 12:02:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:21.355959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff111368-349d-47ab-b424-85d526032b6f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.364938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d24c-c766-4af7-aaad-0c5aa5eb1d01 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.368724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff111368-349d-47ab-b424-85d526032b6f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.370219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.371474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.371793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.372024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] PATH_INFO: `/v3/projects/fc40baff47f04b5082e6645553d446a3/users/7b68f024200a4ef3989f50af9855b3e5/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.375511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.379469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.379469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.379469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] PATH_INFO: `/v3/projects/b59a4a478759428badb325bea53b4dab/users/98f0fddb64e04ef39187cbd44fa8d04a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.389154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc40baff47f04b5082e6645553d446a3, user_id=7b68f024200a4ef3989f50af9855b3e5, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.391955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8f71-a3d5-4dbc-81ab-1777578ae1b9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.394543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59a4a478759428badb325bea53b4dab, user_id=98f0fddb64e04ef39187cbd44fa8d04a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.397614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.475950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 799/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:21 2022] PUT /identity/v3/projects/fc40baff47f04b5082e6645553d446a3/users/7b68f024200a4ef3989f50af9855b3e5/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:21.477504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c88-ec6d-465c-9d0f-804657523bcd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.477793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c88-ec6d-465c-9d0f-804657523bcd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.478102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac1c88-ec6d-465c-9d0f-804657523bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.498315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-24ac1c88-ec6d-465c-9d0f-804657523bcd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.499483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-24ac1c88-ec6d-465c-9d0f-804657523bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.523106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 808/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:21 2022] PUT /identity/v3/projects/b59a4a478759428badb325bea53b4dab/users/98f0fddb64e04ef39187cbd44fa8d04a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:21.523106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.557341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:21.566393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 800/1608] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.567589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.567931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.568261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.583374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2a73-5850-4c6a-87fd-cbe0d95ee362 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.588137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.588796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.589173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.589459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] PATH_INFO: `/v3/projects/4ce401f42fa643ccbefcfd8f4c5387a1/users/d6f93b57456342778a788036406ad4e2/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.604433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce401f42fa643ccbefcfd8f4c5387a1, user_id=d6f93b57456342778a788036406ad4e2, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.606477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.608396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0626-ed1e-490d-a66a-a9fe0657b25b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.608515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.673887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 801/1609] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.675150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.685551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f1082-4c5f-4b39-ba06-391bcc069275 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.692938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.693899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.694180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.694502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] PATH_INFO: `/v3/projects/221fb5fed9fb427b9e211eab312ba0de/users/5e642c2db91e45b38bf777c7a72a5380/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.708173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 809/1610] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:21 2022] PUT /identity/v3/projects/4ce401f42fa643ccbefcfd8f4c5387a1/users/d6f93b57456342778a788036406ad4e2/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:21.708173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3d68-5a78-46f0-b635-3ee84b570c72 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.708173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3d68-5a78-46f0-b635-3ee84b570c72 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.708173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3d68-5a78-46f0-b635-3ee84b570c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.732146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=221fb5fed9fb427b9e211eab312ba0de, user_id=5e642c2db91e45b38bf777c7a72a5380, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.733351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-24db3d68-5a78-46f0-b635-3ee84b570c72 None None] MFA Rules not processed for user `7b68f024200a4ef3989f50af9855b3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.733441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.733525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-24db3d68-5a78-46f0-b635-3ee84b570c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.776646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:21.803926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 810/1611] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.817145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.817487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.817767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.835063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 802/1612] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:21 2022] PUT /identity/v3/projects/221fb5fed9fb427b9e211eab312ba0de/users/5e642c2db91e45b38bf777c7a72a5380/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:21.836264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.843686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.844940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:21.899475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6a7-5ad0-4f09-9080-d381c5b6b75c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:21.903672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:21.904376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.904730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.905077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.911218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 811/1613] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:21.912178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:21.918995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:21.921254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5542-6cbd-4558-91f7-7dc123c63e4b service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:21.934430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 803/1614] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:21.935829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c1ec-8992-42e0-a4b3-2e67658d37e0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:21.936206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c1ec-8992-42e0-a4b3-2e67658d37e0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:21.936556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12c1ec-8992-42e0-a4b3-2e67658d37e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:21.966233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2a12c1ec-8992-42e0-a4b3-2e67658d37e0 None None] MFA Rules not processed for user `d6f93b57456342778a788036406ad4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:21.967234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2a12c1ec-8992-42e0-a4b3-2e67658d37e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:22.002585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a2b20-5a72-4962-85ef-a32cb504c9b8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.011291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.012233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.012652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.013147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.032872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:22.097499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 804/1615] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:22.099045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bac6b-6e2d-4b7a-a6f6-adf454e1699f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.099519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bac6b-6e2d-4b7a-a6f6-adf454e1699f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.099869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bac6b-6e2d-4b7a-a6f6-adf454e1699f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.101339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 805/1616] 10.222.0.18 () {54 vars in 962 bytes} [Fri Aug 12 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:22.103582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.106132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.107516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c514-fe9e-4ce6-9ee9-6c6accec2b57 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.107888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c514-fe9e-4ce6-9ee9-6c6accec2b57 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.108261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4c514-fe9e-4ce6-9ee9-6c6accec2b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.116495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 812/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:22.117312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.127444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3318-19d6-4018-96a8-f7b5e9a7060b service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.131691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.132300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.132634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.138894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.143092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.144679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.145672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f7e4c514-fe9e-4ce6-9ee9-6c6accec2b57 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:22.147110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f7e4c514-fe9e-4ce6-9ee9-6c6accec2b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:22.156000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 813/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:22.156722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.159812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 806/1619] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:22.161139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.161421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.161697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.182347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:22.183672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:22.190132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad741e-3e5b-4944-8f7d-69c1e7044a3d service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.196154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.197010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.197287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.197654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.198324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.200343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.216788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 807/1620] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:22.224413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.240023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8c9f9-898f-497c-aede-e8281357d850 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.246660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.247640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.248153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.248600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.320014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:22.331392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 814/1621] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:22.332542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.348473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.352942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.369202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 808/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:22.370339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.385897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c6e2-738c-4c5c-ba9e-bcbf52c17972 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.400857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fda9c-2b43-44a4-9d82-baf56770241c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.405773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.406580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.406905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.407269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.492918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.493729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.494014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.494339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.495713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.498695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.539017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.540478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387186c-aa4e-4b71-8a2b-00ef4dbc3b6f service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.551823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 815/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:22.553233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ca0-628b-44c1-922a-672e1af012b8 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.553520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ca0-628b-44c1-922a-672e1af012b8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.553791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5ca0-628b-44c1-922a-672e1af012b8 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.558688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 816/1624] 10.222.0.18 () {54 vars in 912 bytes} [Fri Aug 12 12:02:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:22.561526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.562868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.563385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.585684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:22.587248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:22.629117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 809/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:22.632626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.644545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7420a3-2945-4b4d-af0f-6b80f8ef6510 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.650132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.651003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.651441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.652451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.653261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.658353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.689965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 810/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:22.692568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.701827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893575b-f9aa-4bfd-83e6-3a67eced953e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.704060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 817/1627] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:22.718052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.720055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.720644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.721234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.721758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] PATH_INFO: `/v3/projects/dcb8b33d81ca4d878ac27ceba4446355/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.746438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb8b33d81ca4d878ac27ceba4446355, user_id=39fbc0e4dc4c4efa8ab7b7ec0e140f34, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.751528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.760064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:22.795523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39d9b-fc6c-42e5-913d-e23ed7a9c1d8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.800125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.800772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.801051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.801326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.813304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.814835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de35cc-a3fb-40d2-99c0-4475b3bc6ea1 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:22.840607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 818/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:22.844931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad51e2-b9bd-47de-a030-f81c5892f903 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.845226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad51e2-b9bd-47de-a030-f81c5892f903 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.845606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad51e2-b9bd-47de-a030-f81c5892f903 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.847123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 819/1629] 10.222.0.18 () {54 vars in 912 bytes} [Fri Aug 12 12:02:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:22.852893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.853158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.853439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.865300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 811/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:22 2022] PUT /identity/v3/projects/dcb8b33d81ca4d878ac27ceba4446355/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:22.871210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:22.893645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:22.894952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:22.935023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:22.986193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53334-93a6-4839-8e98-81f125578b51 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:22.993033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:22.993430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:22.993750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:22.994028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:22.994836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:22.997597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.008180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 812/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:23.012680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 820/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:23.015194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.021841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.025102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cc22e-f910-4381-882a-22b842e2c71a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.030367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.031161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.031449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.031728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] PATH_INFO: `/v3/projects/dcb8b33d81ca4d878ac27ceba4446355/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.033675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb8b33d81ca4d878ac27ceba4446355, user_id=39fbc0e4dc4c4efa8ab7b7ec0e140f34, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.036422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09e788-4081-43fe-87f8-966130e0036a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.052243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 813/1633] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:23 2022] PUT /identity/v3/projects/dcb8b33d81ca4d878ac27ceba4446355/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:23.064440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515209-c07f-4759-85a5-79ae8c293585 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.065324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515209-c07f-4759-85a5-79ae8c293585 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.065656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515209-c07f-4759-85a5-79ae8c293585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.101525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225796d-e926-4596-a50f-7a24c6185ca6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.134869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2a515209-c07f-4759-85a5-79ae8c293585 None None] MFA Rules not processed for user `39fbc0e4dc4c4efa8ab7b7ec0e140f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:23.137538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2a515209-c07f-4759-85a5-79ae8c293585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:23.209555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.210371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.210745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.211088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.282718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 814/1634] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:23.351085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.352907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.359696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.359986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.360258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.371904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 821/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:23.393519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] MFA Rules not processed for user `a52c9e7a702b4e51b6bc3fb7334db61f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:23.394772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:23.461097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:23.476137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.500795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 815/1636] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:23 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:23.501305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb846c4-f349-4f49-8df6-f693b13275b4 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.509073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.509916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.510128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.510544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.511561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.521892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.523737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.548322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 822/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:23.641700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750173-2cda-446c-9f46-f45aaf4ca778 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.653319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.653958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.655613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.655613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.655613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.657136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.780276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 816/1638] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:23 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:23.784626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.800257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892c335-a896-40ef-a732-a558b166a67a service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.828827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:23.905960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.906755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.908363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.908733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.909535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.911808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:23.947819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:23.962413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0cc3-c48d-4116-82b8-2d4dbd557367 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:23.983405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:23.984196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:23.985018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:23.986113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] PATH_INFO: `/v3/users/7b68f024200a4ef3989f50af9855b3e5` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:23.987505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b68f024200a4ef3989f50af9855b3e5)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:23.989002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:23.989002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 12 12:02:23.989002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: Aug 12 12:02:23.990482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.063626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 823/1639] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:23 2022] POST /identity/v3/users => generated 308 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:02:24.064573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.157091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2841b7-6e3a-410f-a480-841b1cb58717 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.163303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.164018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.164686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.166246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.231686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b68f024200a4ef3989f50af9855b3e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:24.232870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:24.276645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.278210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.291926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 824/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:24.294673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.310392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80493375-6279-463e-b5d5-134231e79f7a service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.317786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.318818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.319389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.323080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.323080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.323080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.339350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 825/1641] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:24.343901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b68f024200a4ef3989f50af9855b3e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:24.626594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.629739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b68f024200a4ef3989f50af9855b3e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:24.630294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c2a64-42e5-42b9-b965-002209f96f57 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.630546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b68f024200a4ef3989f50af9855b3e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:24.630546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-976c508f-ed54-40a3-ac54-dc312e529f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b68f024200a4ef3989f50af9855b3e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:24.630892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.630892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.630892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.630892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] PATH_INFO: `/v3/projects/ffc450298ba14c85b18235a32cfbdee1/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.631535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 817/1642] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:23 2022] DELETE /identity/v3/users/7b68f024200a4ef3989f50af9855b3e5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:02:24.632586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc450298ba14c85b18235a32cfbdee1, user_id=9f1fe06c25fa45a7ac5c43b59cd0a7b4, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.635090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.635428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 818/1643] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:24.635709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.636101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:24.645726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 826/1644] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:24 2022] PUT /identity/v3/projects/ffc450298ba14c85b18235a32cfbdee1/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:24.647221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.650812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:24.719524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315ab1-b25e-4f5f-a75a-6e3ea8d8d096 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.755596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea2cb-2921-45fc-ae35-266be2e93923 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.760243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.761435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.761718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.761988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.762675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.764276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.775115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 827/1645] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:24.779100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.779965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.780115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.780372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.781486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:24.798190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.798738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5271b-bf14-4330-968e-fb5866021360 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:24.800297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.804379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:24.805204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:24.810615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:24.810615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] PATH_INFO: `/v3/projects/ffc450298ba14c85b18235a32cfbdee1/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:24.810615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc450298ba14c85b18235a32cfbdee1, user_id=9f1fe06c25fa45a7ac5c43b59cd0a7b4, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:24.811121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8454c-b7fc-431d-95ab-227d9c6bd87a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:24.814717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 819/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:24.823934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 828/1647] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:24 2022] PUT /identity/v3/projects/ffc450298ba14c85b18235a32cfbdee1/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:02:25.599692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:26.348278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:26.351098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:26.399489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af5cda-0fa6-477a-9bc1-902853e2e66e service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:26.626198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:26.627675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:26.638159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:26.639636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] PATH_INFO: `/v3/projects/fc40baff47f04b5082e6645553d446a3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:26.646449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc40baff47f04b5082e6645553d446a3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:26.656391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:26.877356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc40baff47f04b5082e6645553d446a3', 'request_id': 'req-3c5f1c74-93ea-45a4-82fe-d353916773e3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:26.904812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc40baff47f04b5082e6645553d446a3', 'request_id': 'req-3c5f1c74-93ea-45a4-82fe-d353916773e3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:26.982235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc40baff47f04b5082e6645553d446a3', 'request_id': 'req-3c5f1c74-93ea-45a4-82fe-d353916773e3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:27.000488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] The token cache is being invalidate because project fc40baff47f04b5082e6645553d446a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:27.001085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:27.002684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3c5f1c74-93ea-45a4-82fe-d353916773e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:27.006689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 820/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:26 2022] DELETE /identity/v3/projects/fc40baff47f04b5082e6645553d446a3 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:27.012331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.013232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.013686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.058501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:27.060763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:27.202948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 829/1649] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:27.211128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.211745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.212221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.254121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:27.255928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:27.273306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 821/1650] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:27.278477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:27.306840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbfa-8093-4811-af06-f634c3aeca91 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:27.332954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:27.334023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.336148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.337895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.341818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:27.342095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:27.347172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:27.378388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 830/1651] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:27.384659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:27.400708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5de6-8da7-4d11-8cac-d529cb4cde53 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:27.426106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:27.427124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.427822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.429461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.433599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:27.442706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:27.608484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:27.608731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 822/1652] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:27 2022] POST /identity/v3/projects => generated 355 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:27.622212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7dc85-96d2-46d6-87dd-68a6fc1c717e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:27.654780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:27.731220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:27.732627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.732912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.733190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.734309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:27.736858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:27.843548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:27.867977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8fa03-8f23-4391-b8ac-457f1ae4c279 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:27.870093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 831/1653] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:27 2022] POST /identity/v3/users => generated 278 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:27.896822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:27.900501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.900501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.903115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.904377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:27.910109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:27.939260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 823/1654] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:27.943984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:27.965983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ced7-47cb-4a02-b807-b093bc307ae3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:27.975824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:27.976679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:27.977027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:27.977392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:27.980122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:27.981861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be430c22-fff5-472d-bcba-490adac0a6ce admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:27.997457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 832/1655] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:27.998109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:28.025828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb146-4411-4055-979a-b18689ed70e9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:28.067349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:28.068337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:28.068754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:28.070362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] PATH_INFO: `/v3/projects/54e4140df4bb41bc8ad786d3b9c01089/users/0436dc20c18c491c853a772fcef26e71/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:28.112324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4140df4bb41bc8ad786d3b9c01089, user_id=0436dc20c18c491c853a772fcef26e71, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:28.117541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:28.136561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:28.298245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 824/1656] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:27 2022] PUT /identity/v3/projects/54e4140df4bb41bc8ad786d3b9c01089/users/0436dc20c18c491c853a772fcef26e71/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:02:28.311768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:28.311768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:28.316775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:28.358064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] MFA Rules not processed for user `0436dc20c18c491c853a772fcef26e71`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:28.359837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:28.536048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 833/1657] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:28.540720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:28.612011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e15db-133e-48eb-a19f-f73cc8a016e7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:28.621109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:28.638464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:28.639153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:28.639569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:28.640379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:28.646160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:28.765983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 825/1658] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:28 2022] POST /identity/v3/projects => generated 355 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:28.766236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:28.784742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a058970-fc5f-4492-b8b3-2a0dc1aee452 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:28.914684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:28.915119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:28.915403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:28.915678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:28.916603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:28.921854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:29.064827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 834/1659] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:28 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:29.066208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:29.083441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe248-b3ca-42bf-9702-b5539f572c16 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:29.098908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:29.100037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.100362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.100763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:29.101805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:29.103719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:29.121981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 826/1660] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:29.123398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:29.143147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ba5a-e9db-4bae-b505-8f4cef4a3f26 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:29.149673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:29.152043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.156645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.157004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] PATH_INFO: `/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c/users/ad9eec4b096f4451a1357ed2011e00a6/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:29.178143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fe5defcd6c40d6abf4a1feaef08c9c, user_id=ad9eec4b096f4451a1357ed2011e00a6, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:29.181250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:29.186578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:29.303605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 835/1661] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:29 2022] PUT /identity/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c/users/ad9eec4b096f4451a1357ed2011e00a6/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:29.304941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:29.328202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fca328-dee0-47f5-a8ac-397c7b0a6120 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:29.438635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:29.438635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.438635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.438635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:29.440156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:29.440156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894f6ee-4256-424f-8107-30afb4da9ab2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:29.464561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 827/1662] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:29.468423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:29.482991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d927b-8fa1-42ca-a490-c437c0156646 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:29.493554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:29.494765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.495741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.496789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] PATH_INFO: `/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c/users/ad9eec4b096f4451a1357ed2011e00a6/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:29.501350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fe5defcd6c40d6abf4a1feaef08c9c, user_id=ad9eec4b096f4451a1357ed2011e00a6, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:29.505196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:29.543179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 836/1663] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:29 2022] PUT /identity/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c/users/ad9eec4b096f4451a1357ed2011e00a6/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:29.556665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.557634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.558962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:29.608036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] MFA Rules not processed for user `ad9eec4b096f4451a1357ed2011e00a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:29.613755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:29.776985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 828/1664] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:29.790785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:29.793966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:29.949379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:29.952420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7d90-e966-4a72-b617-82b4d0d8e71e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:29.962637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:29.964908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:29.966029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:29.969694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:30.006683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:30.015436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36f05-22f6-4de9-92de-4fd7a0ff585d service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:30.039384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 837/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:30.509674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:30.538026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd051ce-60ab-4f5f-b288-d7a1ba636da8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:30.559640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003499-ef25-4891-b4eb-ec95731ae286 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:30.560554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003499-ef25-4891-b4eb-ec95731ae286 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:30.561144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003499-ef25-4891-b4eb-ec95731ae286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:30.564265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:30.566209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:30.567805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:30.570617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:30.641916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c0003499-ef25-4891-b4eb-ec95731ae286 None None] MFA Rules not processed for user `9f1fe06c25fa45a7ac5c43b59cd0a7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:30.645535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c0003499-ef25-4891-b4eb-ec95731ae286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:30.758782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:30.765041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:30.815833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 829/1666] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:30.833124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 838/1667] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:30 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:31.578392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:31.578926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:31.721978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f354-c105-4490-877d-14638ab4199d service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:31.740160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:31.741064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:31.741566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:31.741974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] PATH_INFO: `/v3/users/c8da9964c697450eb7b3bef2620b130e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:31.744478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8da9964c697450eb7b3bef2620b130e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:31.747711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:32.028536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:32.040197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8da9964c697450eb7b3bef2620b130e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:32.122567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8da9964c697450eb7b3bef2620b130e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:32.154353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8da9964c697450eb7b3bef2620b130e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:32.178823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8da9964c697450eb7b3bef2620b130e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:32.181394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8da9964c697450eb7b3bef2620b130e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:32.203757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 830/1668] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:31 2022] DELETE /identity/v3/users/c8da9964c697450eb7b3bef2620b130e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:32.214744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a7b21-416f-412e-b287-6149e7779e2a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:32.214744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a7b21-416f-412e-b287-6149e7779e2a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:32.214744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a7b21-416f-412e-b287-6149e7779e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:32.247185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f80a7b21-416f-412e-b287-6149e7779e2a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:32.249061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f80a7b21-416f-412e-b287-6149e7779e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:32.376852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 839/1669] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:32.451382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:32.455172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:32.592676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c144cd8-cf05-4341-a8ba-473b48c520bb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:32.605480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:32.606114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:32.606393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:32.606730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:32.630448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:32.631947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff04926-d684-470a-abd2-d1fa2a90e8a7 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:32.651274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 831/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:33.261858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa211cc-4c6e-4d3e-89c2-de5225f6b34f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:33.266642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa211cc-4c6e-4d3e-89c2-de5225f6b34f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:33.266642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa211cc-4c6e-4d3e-89c2-de5225f6b34f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:33.266642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 840/1671] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:02:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:33.296308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cecf-31ad-4990-aefd-2d11879cebfe None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:33.296600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cecf-31ad-4990-aefd-2d11879cebfe None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:33.296886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662cecf-31ad-4990-aefd-2d11879cebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:33.331901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4662cecf-31ad-4990-aefd-2d11879cebfe None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:33.336674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4662cecf-31ad-4990-aefd-2d11879cebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:33.438769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 832/1672] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:33.480731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3e97-07b4-4638-ab0e-f2e013c7e88d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:33.481557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3e97-07b4-4638-ab0e-f2e013c7e88d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:33.482023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3e97-07b4-4638-ab0e-f2e013c7e88d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:33.484237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 841/1673] 10.222.0.18 () {54 vars in 961 bytes} [Fri Aug 12 12:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:33.490644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:33.491065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:33.491431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:33.528064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:33.530304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:33.552710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 833/1674] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Aug 12 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:33.569775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3e97-07b4-4638-ab0e-f2e013c7e88d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:33.595983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3e97-07b4-4638-ab0e-f2e013c7e88d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:33.617960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:33.619111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:33.621402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:33.622941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:33.646324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:33.651159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:33.656498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:33.685895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 842/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:34.821893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:34.823467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:34.837194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:34.838831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:34.869408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab384e9a-94a4-4627-9ec7-ef000fe745d7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:34.871771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48fb5c-d725-4098-be8c-adc1455c68cc service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:34.879782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:34.880446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:34.881153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:34.881432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] PATH_INFO: `/v3/users/a52c9e7a702b4e51b6bc3fb7334db61f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:34.882591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:34.883467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:34.883880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:34.884278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] PATH_INFO: `/v3/projects/8c2559da5d6e4a58b6beaa5ed16054ad` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:34.885067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52c9e7a702b4e51b6bc3fb7334db61f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:34.887807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:34.888707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2559da5d6e4a58b6beaa5ed16054ad)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:34.889725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 12:02:34.889725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 12 12:02:34.889725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: Aug 12 12:02:34.890939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:35.164313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52c9e7a702b4e51b6bc3fb7334db61f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.176402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:35.206481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2559da5d6e4a58b6beaa5ed16054ad', 'request_id': 'req-9bc83235-c95c-4375-b437-0060bc0d4e4a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.271360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2559da5d6e4a58b6beaa5ed16054ad', 'request_id': 'req-9bc83235-c95c-4375-b437-0060bc0d4e4a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.273808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52c9e7a702b4e51b6bc3fb7334db61f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.297416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52c9e7a702b4e51b6bc3fb7334db61f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.327969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52c9e7a702b4e51b6bc3fb7334db61f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.329600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5af01ee5-9bbf-4fa4-bf7f-616b62fe8107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52c9e7a702b4e51b6bc3fb7334db61f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.364437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 834/1676] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:34 2022] DELETE /identity/v3/users/a52c9e7a702b4e51b6bc3fb7334db61f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:35.388766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2559da5d6e4a58b6beaa5ed16054ad', 'request_id': 'req-9bc83235-c95c-4375-b437-0060bc0d4e4a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.424015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] The token cache is being invalidate because project 8c2559da5d6e4a58b6beaa5ed16054ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:35.429269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.433691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bc83235-c95c-4375-b437-0060bc0d4e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:35.438976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 843/1677] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:34 2022] DELETE /identity/v3/projects/8c2559da5d6e4a58b6beaa5ed16054ad => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:35.447979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bb95-16cf-4727-b39c-2e5a9ffb9dcc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.448791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bb95-16cf-4727-b39c-2e5a9ffb9dcc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.449063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bb95-16cf-4727-b39c-2e5a9ffb9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.461671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bc5c-a95a-47b0-bacf-0117dfd551ca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.461975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bc5c-a95a-47b0-bacf-0117dfd551ca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.462253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bc5c-a95a-47b0-bacf-0117dfd551ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.547563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e014bb95-16cf-4727-b39c-2e5a9ffb9dcc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:35.549585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e014bb95-16cf-4727-b39c-2e5a9ffb9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:35.570059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f0c8bc5c-a95a-47b0-bacf-0117dfd551ca None None] MFA Rules not processed for user `601eeaeae5024d48a762049ecbc3bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:35.576858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f0c8bc5c-a95a-47b0-bacf-0117dfd551ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:35.691865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 835/1678] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:35.696088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.696383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.696820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.708830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 844/1679] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:35.723481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.726315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.726771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.739496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:35.741755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:35.758593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 836/1680] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:35.761435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:35.773967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] MFA Rules not processed for user `601eeaeae5024d48a762049ecbc3bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:35.774883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7187-07d4-4e1f-bc3b-6bd9644eb467 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:35.779485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:35.781254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:35.782475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.783058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.783564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.784513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:35.785074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:35.787231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:35.802876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 845/1681] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:35.818476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:35.819445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:35.820932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 837/1682] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:02:35.822275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:35.844152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7bd1-e4f7-4c6c-98ad-02400ef710bd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:35.851587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:35.852519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:35.853191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:35.853674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:35.854654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:35.857782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:35.935436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:35.975611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 838/1683] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:35.978470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:36.034751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9aee0-296a-44db-b890-fe471f79e6ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:36.121672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a7d15-32ec-4abb-b93b-43ae22d2b61e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:36.145980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:36.148009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.150186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.150472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.155095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:36.160334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:36.299533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:36.300920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.301355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.302614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.318605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 839/1684] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:35 2022] POST /identity/v3/users => generated 290 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:36.322949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:36.367884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59499-356a-4ced-b952-47d82f44f851 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:36.378992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:36.379647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.379935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.380203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.380871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:36.386320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:36.421837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 840/1685] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:36.428981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:36.448293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749223b-4b5e-4ca4-959b-e20a7859556c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:36.487242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:36.494908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.498900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.499217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.501801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:36.503117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:36.509063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:36.535674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fcf51-38d3-4228-8d7a-3567599d30f7 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:36.563296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 841/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:02:36.564387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:36.578860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 846/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:36.601274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a61d9-3dd3-46dc-b23c-6a13b9f832cf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:36.631293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:36.632012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.632331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.632861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] PATH_INFO: `/v3/projects/f94be582424541d8b89a6b59149499a1/users/63c2103bab3249cea6f5414734edf238/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.763629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94be582424541d8b89a6b59149499a1, user_id=63c2103bab3249cea6f5414734edf238, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:36.768625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:36.885541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 842/1688] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:36 2022] PUT /identity/v3/projects/f94be582424541d8b89a6b59149499a1/users/63c2103bab3249cea6f5414734edf238/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:36.887136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:36.887469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:36.887751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:36.995231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] MFA Rules not processed for user `63c2103bab3249cea6f5414734edf238`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:37.001131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:37.027961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:37.161137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:37.162108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 847/1689] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:37.357880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62de3-5305-47c5-b733-c59f047a5978 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:37.368710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:37.369748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:37.370831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:37.371799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:37.372680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:37.374887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:37.454957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:37.461058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:37.499942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc26d7-8ffb-47ac-899c-59d3c0dd5d92 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:37.509623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 843/1690] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:37 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:37.512478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:37.516497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:37.517159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:37.520302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:37.520302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] PATH_INFO: `/v3/projects/6f54e9091b774d80816c5db6634c96b7` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:37.520990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f54e9091b774d80816c5db6634c96b7)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:37.529116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:37.716513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a893c9-4ed0-4003-99af-c29343c4c065 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:37.743874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f54e9091b774d80816c5db6634c96b7', 'request_id': 'req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:37.762255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f54e9091b774d80816c5db6634c96b7', 'request_id': 'req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:37.888430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f54e9091b774d80816c5db6634c96b7', 'request_id': 'req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:37.923944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] The token cache is being invalidate because project 6f54e9091b774d80816c5db6634c96b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:37.927306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:37.930039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0d985bf2-ee1c-4334-bb82-24d4d0922cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:37.932611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:37.935244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:37.936288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:37.936495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 848/1691] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:37 2022] DELETE /identity/v3/projects/6f54e9091b774d80816c5db6634c96b7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:37.939957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:37.940830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:37.943901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5ee04-d7d6-436e-8428-7f72dda8a177 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:37.944308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:37.946568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:37.947058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:37.960689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 849/1692] 10.222.0.18 () {54 vars in 912 bytes} [Fri Aug 12 12:02:37 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:37.963200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:37.978146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:38.009315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb84d-9a8a-4965-add8-e783451d4670 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.014593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.015397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.015995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.016341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] PATH_INFO: `/v3/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.018249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1fe06c25fa45a7ac5c43b59cd0a7b4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.020373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.083127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 844/1693] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:37 2022] POST /identity/v3/users => generated 296 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:38.085673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.086186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.086714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.124612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:38.148223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:38.149685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:38.227948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 845/1694] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:02:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:38.228947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:38.231961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:38.251016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16316b-ec50-4b85-814c-e567c5ec88eb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.256632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.257537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.257879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.258633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.259490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.261927 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.280502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1fe06c25fa45a7ac5c43b59cd0a7b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:38.280751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 846/1695] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:38.282087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:38.283882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:38.302434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba5fef-acdb-4003-a835-bef264f5b29e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.307834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.308475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.308755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.309029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.318073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.319902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.333399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 847/1696] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:38.334046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:38.354598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e947247-4032-4197-bb79-d054bdbda602 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.358826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1fe06c25fa45a7ac5c43b59cd0a7b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:38.360965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.361709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.361994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.362276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] PATH_INFO: `/v3/projects/708fa4314a284c37ae8bd529ca00feb5/users/d64f6fd7d2ad40a8a38c7e019a14c3a9/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.380878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1fe06c25fa45a7ac5c43b59cd0a7b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:38.381236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=708fa4314a284c37ae8bd529ca00feb5, user_id=d64f6fd7d2ad40a8a38c7e019a14c3a9, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.385421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.401870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1fe06c25fa45a7ac5c43b59cd0a7b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:38.402980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1fe06c25fa45a7ac5c43b59cd0a7b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:38.413536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 850/1697] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:37 2022] DELETE /identity/v3/users/9f1fe06c25fa45a7ac5c43b59cd0a7b4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:38.481476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 848/1698] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:38 2022] PUT /identity/v3/projects/708fa4314a284c37ae8bd529ca00feb5/users/d64f6fd7d2ad40a8a38c7e019a14c3a9/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:38.485680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:38.487438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:38.641767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dde19-d509-4518-b9df-8fe5068cdfaf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.716039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:38.795387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.796374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.796999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.797811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.800875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.803965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4b2a5-8b2e-440c-977f-10314c87e56d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.853704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:38.861474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 851/1699] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:38.862705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:38.889410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c716c69-dc13-48be-9c51-a34bfd052df6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:38.897674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:38.898544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.898979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.899510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] PATH_INFO: `/v3/projects/708fa4314a284c37ae8bd529ca00feb5/users/d64f6fd7d2ad40a8a38c7e019a14c3a9/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:38.903553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=708fa4314a284c37ae8bd529ca00feb5, user_id=d64f6fd7d2ad40a8a38c7e019a14c3a9, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:38.907639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:38.931147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 849/1700] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:38 2022] PUT /identity/v3/projects/708fa4314a284c37ae8bd529ca00feb5/users/d64f6fd7d2ad40a8a38c7e019a14c3a9/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:38.943104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:38.946554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:38.946816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:39.009372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] MFA Rules not processed for user `d64f6fd7d2ad40a8a38c7e019a14c3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:39.011269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:39.175648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:39.177851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:39.203587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 852/1701] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:39.251340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:39.270869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:39.434067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed1763-fcf3-4bd7-ad3a-e853270c1b7e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:39.454546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:39.455197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:39.455465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:39.461445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] PATH_INFO: `/v3/projects/ffc450298ba14c85b18235a32cfbdee1` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:39.467064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc450298ba14c85b18235a32cfbdee1)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:39.470337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:39.485347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f73914-2fd4-46ec-8c8d-9607a020eba9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:39.504755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:39.506582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:39.508907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:39.511098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:39.546113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:39.548704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:39.597180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 853/1702] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:39.737027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:39.738764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:39.749360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc450298ba14c85b18235a32cfbdee1', 'request_id': 'req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:39.767991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc450298ba14c85b18235a32cfbdee1', 'request_id': 'req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:39.883398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc450298ba14c85b18235a32cfbdee1', 'request_id': 'req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:39.904267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] The token cache is being invalidate because project ffc450298ba14c85b18235a32cfbdee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:39.904629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:39.906594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d5cccfe3-3e93-4bef-a9ae-2676eac58a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:39.911933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 850/1703] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:39 2022] DELETE /identity/v3/projects/ffc450298ba14c85b18235a32cfbdee1 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:39.922601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae1e4-bc91-404c-a8f5-73a8481db9d7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:39.922601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae1e4-bc91-404c-a8f5-73a8481db9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:39.924155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae1e4-bc91-404c-a8f5-73a8481db9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:39.951708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f77fb-6179-4925-8d54-93b111d85d8e service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:39.981289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-60aae1e4-bc91-404c-a8f5-73a8481db9d7 None None] MFA Rules not processed for user `601eeaeae5024d48a762049ecbc3bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:39.983264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-60aae1e4-bc91-404c-a8f5-73a8481db9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:39.992764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=5,keystone:SELECT=94,keystone:DELETE=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.104105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:40.111383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.117006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.117006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.117006 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:40.133775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:40.142455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 851/1704] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:40.146858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e9e5-b998-4db0-b907-f157e022c962 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.147152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e9e5-b998-4db0-b907-f157e022c962 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.147436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e9e5-b998-4db0-b907-f157e022c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.147918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:40.161677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 854/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:40.163155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:40.164811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:40.194826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c78e9e5-b998-4db0-b907-f157e022c962 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:40.198957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c78e9e5-b998-4db0-b907-f157e022c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:40.241995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4ffe-cd1d-4db0-b9cc-c17e39cffa68 service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:40.247864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:40.248722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.253169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.253169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.253169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:40.299391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 852/1706] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:40.306198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.306496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.306887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.356994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:40.358627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:40.365649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:40.368195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:40.380305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 853/1707] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:40.383491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:40.384957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 855/1708] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:40.390754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:40.412970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce557fe4-7cca-44c4-b1af-ca1a6ea60f4b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:40.438649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:40.439276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.439736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.440016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.440679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:02:40.441008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:40.442746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:40.499224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 854/1709] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:02:40.504014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:40.522227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03da4dc-1f34-41a5-87c6-0b4dba77900b service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:40.544029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:40.544715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.545000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.554947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.556517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:40.568855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:40.765993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 856/1710] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:40 2022] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:40.770104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:40.781575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf495046-50a2-42d5-b7f3-ba251baef50e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:40.965768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:40.968449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:40.971075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:40.972169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:40.973589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:40.996131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:41.127917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 855/1711] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:40 2022] POST /identity/v3/users => generated 288 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:02:41.133676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:41.164312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167066a9-2d54-48d3-ae99-3be1dee385fb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:41.181540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:41.182373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.183073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.183489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.184345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:41.189312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:41.219737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 857/1712] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:41.222121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:41.237256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4e168-03ad-49c4-9d3a-5f7e33fdceaa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:41.247841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:41.248530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.248814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.249309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.249800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:41.251485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c3f83-9a3a-42c0-be61-c2bb6b71a928 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:41.267671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 856/1713] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:41.269650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:41.284377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c4835-e298-4956-989d-8e6b1a032920 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:41.290337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:41.291903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.292405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.292895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] PATH_INFO: `/v3/projects/79c272b32dfc465ea0ded76ad9ea0abe/users/e0aae052295e4abc850252e79ad07491/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.295910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:41.344591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c272b32dfc465ea0ded76ad9ea0abe, user_id=e0aae052295e4abc850252e79ad07491, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:41.348025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b99538-356a-4532-b43e-58a62bb192f0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:41.441126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:41.461008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 858/1714] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:41 2022] PUT /identity/v3/projects/79c272b32dfc465ea0ded76ad9ea0abe/users/e0aae052295e4abc850252e79ad07491/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:41.477394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb171e-894a-4017-bcb5-253995b293f5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.479273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb171e-894a-4017-bcb5-253995b293f5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.479974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb171e-894a-4017-bcb5-253995b293f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.536590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-38fb171e-894a-4017-bcb5-253995b293f5 None None] MFA Rules not processed for user `e0aae052295e4abc850252e79ad07491`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:41.540282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-38fb171e-894a-4017-bcb5-253995b293f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:41.541469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.541792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.542082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.607293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] MFA Rules not processed for user `98f0fddb64e04ef39187cbd44fa8d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:41.608748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:41.701306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 857/1715] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:41.701647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.701926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.702196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.792323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] MFA Rules not processed for user `5e642c2db91e45b38bf777c7a72a5380`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:41.793566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:41.805180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 859/1716] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:41.815282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:41.952767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc064-8d2d-4682-befe-8d53ba2bbd66 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:41.970372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:41.971040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:41.971751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:41.972181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:41.972968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:41.975300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498de9be-6e0e-4870-8ad2-b90da5bba3a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:41.978169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 858/1717] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:41.979564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:41.981622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:42.127250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 860/1718] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:02:41 2022] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:42.128591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.130531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.130639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.197181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0dc3-1461-4405-b2d0-df17209ccde4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:42.221131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] MFA Rules not processed for user `484d1b3c58834adcb10a32c410f9c986`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:42.223521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:42.375668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:42.376640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.377337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.378414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.420125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 861/1719] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:42.421526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:42.424306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:42.461888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606e927-0189-4e4f-b1f5-e8ba5ad7d3a2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:42.472026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:42.474568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:42.482653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:42.483288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.483572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.483844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.499791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 859/1720] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:42.501115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:42.616535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:42.641198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:42.642834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9189e9-c0b0-45a0-a812-ec759a0e4bd6 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:42.657219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760d46-b689-42bd-8dfb-7f67e23e81c2 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:42.683484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 862/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:42.684506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:42.685149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.685428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.685701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.688136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:42.688908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.689401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.689815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.690138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:42.754870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] MFA Rules not processed for user `484d1b3c58834adcb10a32c410f9c986`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:42.763309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:42.786571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 863/1722] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:42.812520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 860/1723] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:02:42 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:02:42.816380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:42.828095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c577b-8be7-41ee-b567-aed2b8e77664 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:42.838178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:42.839352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.839851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.840268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.841156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:42.843683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:42.859002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 864/1724] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:42.860822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:42.873098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892d403-c08b-4bb0-ae35-eae3f47ea2f2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:42.902188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:42.903148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:42.903582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:42.903867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] PATH_INFO: `/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b/users/1eb34906e79a4762a9d1977e612f2f65/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:42.935401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c85e9def454bbe9948f6dbe3b2b94b, user_id=1eb34906e79a4762a9d1977e612f2f65, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:42.938432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:43.023102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:43.060562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90b17-db2d-4ec3-8170-0af55fb11d34 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:43.076406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:43.077252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.079636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.079636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.079810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 861/1725] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:42 2022] PUT /identity/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b/users/1eb34906e79a4762a9d1977e612f2f65/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:02:43.082639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:43.090964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:43.092840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:43.104207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 865/1726] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:43.229444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804dd46-b0c2-4481-869b-bc9273cc5e8b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:43.237595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:43.238608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.239783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.252656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.255028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:43.257295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4af438-f1ad-46e2-b918-054b1321a9eb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:43.290601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 862/1727] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:02:43.295193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:43.317096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f5c8-ef7d-403d-aeb1-dbe0cfb7f2ad service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:43.330266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:43.332184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.335343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.354463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] PATH_INFO: `/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b/users/1eb34906e79a4762a9d1977e612f2f65/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.362582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c85e9def454bbe9948f6dbe3b2b94b, user_id=1eb34906e79a4762a9d1977e612f2f65, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:43.373663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88541164-c4ea-4f0e-ab06-48ebb995c129 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:43.427352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 866/1728] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:02:43 2022] PUT /identity/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b/users/1eb34906e79a4762a9d1977e612f2f65/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:43.430218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c149c5-0088-4d45-a7e7-7d16da3d6721 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.430760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c149c5-0088-4d45-a7e7-7d16da3d6721 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.430833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c149c5-0088-4d45-a7e7-7d16da3d6721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.471067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:43.533058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-00c149c5-0088-4d45-a7e7-7d16da3d6721 None None] MFA Rules not processed for user `1eb34906e79a4762a9d1977e612f2f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:43.537514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-00c149c5-0088-4d45-a7e7-7d16da3d6721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:43.716009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 863/1729] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:43.923826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.924327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.926752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.942091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 867/1730] 10.222.0.18 () {54 vars in 912 bytes} [Fri Aug 12 12:02:43 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:43.948853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:43.949121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:43.949627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:43.974404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:43.975935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:44.041429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 864/1731] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:44.054804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:44.057075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:44.074397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec22f-4cd7-4b39-98f0-afd6cc47fa30 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:44.078147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:44.078785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:44.079061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:44.079332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:44.087690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:44.090025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a281e78-10dd-481f-bb51-c79a3f59c6ca service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:44.103541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 868/1732] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:44.540415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:44.718670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b38729-8d8b-44c3-bbae-ea86dbc7d204 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:44.732431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:44.733163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:44.735012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:44.735635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:44.912853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:44.915311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:44.939331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 865/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:45.340569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:45.595953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aa85-f7b5-4982-b7bf-04e68028311a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:45.596454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aa85-f7b5-4982-b7bf-04e68028311a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:45.596681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aa85-f7b5-4982-b7bf-04e68028311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:45.874324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1561aa85-f7b5-4982-b7bf-04e68028311a None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:45.875687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1561aa85-f7b5-4982-b7bf-04e68028311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:46.025266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:46.055045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 869/1734] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:02:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:46.542315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:46.543947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:46.765267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c42d3-40b7-4096-99fe-15c24e0ce342 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:46.773239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:46.773936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:46.774634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:46.775163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:46.795564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:46.797493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:46.827788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 866/1735] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:02:47.387974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:49.493605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94d2-59ab-4a25-8d08-997b3b2eda0e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:49.494118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94d2-59ab-4a25-8d08-997b3b2eda0e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:49.494304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94d2-59ab-4a25-8d08-997b3b2eda0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:49.569379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-589e94d2-59ab-4a25-8d08-997b3b2eda0e None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:49.572811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-589e94d2-59ab-4a25-8d08-997b3b2eda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:49.610634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 870/1736] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Aug 12 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:49.736287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:49.741472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:49.755708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0dad6-b401-45f3-8b12-c12ac1e76a02 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:49.791673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:49.796850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:49.797697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:49.798171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:49.854071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:49.856040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:49.875358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 867/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:50.362920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94eda0-5331-4e59-8611-5b53f516ae6d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:50.363215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94eda0-5331-4e59-8611-5b53f516ae6d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:50.363498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94eda0-5331-4e59-8611-5b53f516ae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:50.409055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fb94eda0-5331-4e59-8611-5b53f516ae6d None None] MFA Rules not processed for user `5e642c2db91e45b38bf777c7a72a5380`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:50.410792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb94eda0-5331-4e59-8611-5b53f516ae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:50.538473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 871/1738] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:50.707696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:50.709597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:50.727662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c05fa3-dd24-49d8-b461-e9d0e73936db service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:50.734102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:50.735529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:50.735907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:50.736818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:50.751563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:50.755001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e01489-d77f-4f7d-9d5b-eeed5f0c9a78 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:50.797956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 868/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:53.022472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b8c-412e-4ebf-8f1a-8cb1a2cc3da9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:53.025025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b8c-412e-4ebf-8f1a-8cb1a2cc3da9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:53.028554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b8c-412e-4ebf-8f1a-8cb1a2cc3da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:53.082135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9d889b8c-412e-4ebf-8f1a-8cb1a2cc3da9 None None] MFA Rules not processed for user `98f0fddb64e04ef39187cbd44fa8d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:53.083760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9d889b8c-412e-4ebf-8f1a-8cb1a2cc3da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:53.248198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 872/1740] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:53.808201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:53.808201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:53.808201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:53.808984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 869/1741] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:53.821301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632378-c254-499c-86ae-27d401b033e4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:53.821760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632378-c254-499c-86ae-27d401b033e4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:53.822460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15632378-c254-499c-86ae-27d401b033e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:53.891538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-15632378-c254-499c-86ae-27d401b033e4 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:53.897367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-15632378-c254-499c-86ae-27d401b033e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:54.069852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 873/1742] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:54.409855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:54.412210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:54.427477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:54.547502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58ead-058b-4fe7-8ade-80e7f2760d87 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:54.561772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:54.562739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:54.563161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:54.563575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] PATH_INFO: `/v3/users/63c2103bab3249cea6f5414734edf238` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:54.564922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c2103bab3249cea6f5414734edf238)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:54.567060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:54.806030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15632378-c254-499c-86ae-27d401b033e4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:54.824223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15632378-c254-499c-86ae-27d401b033e4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:54.839587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c2103bab3249cea6f5414734edf238'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:54.843465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:54.846666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:54.846666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:54.846666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:54.870148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:54.872619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a919-770d-4d8b-b69d-fa02b7fb742f service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:54.899567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 874/1743] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:54.914438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de4fc-144d-40b8-b522-46b21dd8f109 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:54.915059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de4fc-144d-40b8-b522-46b21dd8f109 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:54.915910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de4fc-144d-40b8-b522-46b21dd8f109 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:54.919382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 875/1744] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:02:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:02:54.936627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c2103bab3249cea6f5414734edf238'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:54.966711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c2103bab3249cea6f5414734edf238'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:54.981278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c2103bab3249cea6f5414734edf238'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:54.986361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff470d02-11ae-4a43-92c5-50376a176cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c2103bab3249cea6f5414734edf238'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:54.999644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 870/1745] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:54 2022] DELETE /identity/v3/users/63c2103bab3249cea6f5414734edf238 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:55.004117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:55.004406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:55.004750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:55.016586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:55.016937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:55.017213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:55.077566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:55.082406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:55.103697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:55.107096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:55.208487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:55.329496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 876/1746] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:55.367648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:55.369482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:55.413462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 871/1747] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:02:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:02:55.575829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62f0c6-33a3-4b5d-94be-b47f727042ea None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:55.586793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:55.586793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:55.586793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:55.586793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:55.600878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:55.603420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:55.628202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 877/1748] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:02:55.843304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:55.845464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:55.869392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc96c5-9902-414e-ab7e-d2e629d1740a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:55.876798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:55.877521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:55.877894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:55.878410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:55.919382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:55.923975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:55.961430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 872/1749] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:56.903252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:56.905261 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:56.928439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ecc99-a0c6-49ae-8c3e-5175f8329448 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:56.944128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:56.944873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:56.945155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:56.945428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] PATH_INFO: `/v3/users/0436dc20c18c491c853a772fcef26e71` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:56.946646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0436dc20c18c491c853a772fcef26e71)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:56.949262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:57.729927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0436dc20c18c491c853a772fcef26e71'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.027674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0436dc20c18c491c853a772fcef26e71'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.039607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:58.041127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:58.059695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:58.060608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0436dc20c18c491c853a772fcef26e71'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.071011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021195-9ee7-4f56-a830-37ed627c60bf service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:58.075655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0436dc20c18c491c853a772fcef26e71'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.077431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a85bc3fa-cc4a-4fc9-8b11-7b87619b4c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0436dc20c18c491c853a772fcef26e71'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.079831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:58.081763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:58.081763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:58.081763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] PATH_INFO: `/v3/projects/f94be582424541d8b89a6b59149499a1` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:58.088855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 878/1750] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:56 2022] DELETE /identity/v3/users/0436dc20c18c491c853a772fcef26e71 => generated 0 bytes in 1183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:58.095639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94be582424541d8b89a6b59149499a1)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:58.097221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:58.097528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:58.097780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:58.107504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:58.132747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:58.134049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:58.201120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:02:58.230966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 879/1751] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:02:58.242479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:58.244827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:58.316758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845fdd-d736-46fc-91ef-e4c1138b49f1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:58.330779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94be582424541d8b89a6b59149499a1', 'request_id': 'req-279533d3-bfb7-492e-bb94-e0ff7f95eacd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.344061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94be582424541d8b89a6b59149499a1', 'request_id': 'req-279533d3-bfb7-492e-bb94-e0ff7f95eacd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.402264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:58.402939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:58.403209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:58.403479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:58.439516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94be582424541d8b89a6b59149499a1', 'request_id': 'req-279533d3-bfb7-492e-bb94-e0ff7f95eacd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.468197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] The token cache is being invalidate because project f94be582424541d8b89a6b59149499a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:58.468505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.470685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.475402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 873/1752] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:58 2022] DELETE /identity/v3/projects/f94be582424541d8b89a6b59149499a1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:58.476790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:58.479698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:58.523489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:58.527073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:58.537494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 880/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:02:58.592189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279533d3-bfb7-492e-bb94-e0ff7f95eacd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:58.606659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:58.607904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:58.608413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:58.608874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] PATH_INFO: `/v3/users/d64f6fd7d2ad40a8a38c7e019a14c3a9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:58.611578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64f6fd7d2ad40a8a38c7e019a14c3a9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:58.613358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:58.847528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64f6fd7d2ad40a8a38c7e019a14c3a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.929525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64f6fd7d2ad40a8a38c7e019a14c3a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.951511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64f6fd7d2ad40a8a38c7e019a14c3a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.981715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64f6fd7d2ad40a8a38c7e019a14c3a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.982683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64f6fd7d2ad40a8a38c7e019a14c3a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:58.995386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 874/1754] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:58 2022] DELETE /identity/v3/users/d64f6fd7d2ad40a8a38c7e019a14c3a9 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:59.317670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:59.319870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:59.339076 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae19ce-8e0c-420e-bdde-d058f36152fa service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:59.401821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:59.402257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:59.402625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:59.402902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] PATH_INFO: `/v3/projects/54e4140df4bb41bc8ad786d3b9c01089` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:59.404067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e4140df4bb41bc8ad786d3b9c01089)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:59.406073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:59.559376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e4140df4bb41bc8ad786d3b9c01089', 'request_id': 'req-27dac05b-1e85-4323-9d9a-dd8ad4e30349'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.566110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e4140df4bb41bc8ad786d3b9c01089', 'request_id': 'req-27dac05b-1e85-4323-9d9a-dd8ad4e30349'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.615386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:59.616972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:59.634294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0feb299-d310-4d7c-9c1c-23b6771735bf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:59.660967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e4140df4bb41bc8ad786d3b9c01089', 'request_id': 'req-27dac05b-1e85-4323-9d9a-dd8ad4e30349'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.674882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] The token cache is being invalidate because project 54e4140df4bb41bc8ad786d3b9c01089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:59.675435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.676075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.677564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 881/1755] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:59 2022] DELETE /identity/v3/projects/54e4140df4bb41bc8ad786d3b9c01089 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:02:59.681396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:02:59.683214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:02:59.695869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:59.696584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:59.696819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:59.697093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] PATH_INFO: `/v3/projects/708fa4314a284c37ae8bd529ca00feb5` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:59.698917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=708fa4314a284c37ae8bd529ca00feb5)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:59.700835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:59.747128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dac05b-1e85-4323-9d9a-dd8ad4e30349 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:02:59.755853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:02:59.755853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:59.755853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:59.755853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] PATH_INFO: `/v3/users/ad9eec4b096f4451a1357ed2011e00a6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:59.756159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9eec4b096f4451a1357ed2011e00a6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:02:59.757958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:02:59.850242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708fa4314a284c37ae8bd529ca00feb5', 'request_id': 'req-2699ae6a-4511-48d6-ab80-4008b25a19f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.856463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708fa4314a284c37ae8bd529ca00feb5', 'request_id': 'req-2699ae6a-4511-48d6-ab80-4008b25a19f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.927512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708fa4314a284c37ae8bd529ca00feb5', 'request_id': 'req-2699ae6a-4511-48d6-ab80-4008b25a19f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.948428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] The token cache is being invalidate because project 708fa4314a284c37ae8bd529ca00feb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:02:59.948849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.951105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2699ae6a-4511-48d6-ab80-4008b25a19f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:02:59.955745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 875/1756] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:02:59 2022] DELETE /identity/v3/projects/708fa4314a284c37ae8bd529ca00feb5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:02:59.961377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b639a-6152-438a-891e-ebb6ca3684a4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:02:59.964686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b639a-6152-438a-891e-ebb6ca3684a4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:02:59.965193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b639a-6152-438a-891e-ebb6ca3684a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:02:59.987700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9a4b639a-6152-438a-891e-ebb6ca3684a4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:02:59.988922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a4b639a-6152-438a-891e-ebb6ca3684a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.060337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 876/1757] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:00.068278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.068954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.069851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.098251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9eec4b096f4451a1357ed2011e00a6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.105298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:00.106575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.126859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 877/1758] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:00.131194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.142189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1b297-7e57-4e01-91c3-cd03d8bfd927 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.147031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.147713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.148055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.148335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.149166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:00.149504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.151142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.177414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 878/1759] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:00.178506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.186856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9eec4b096f4451a1357ed2011e00a6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.192480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db90071-8952-460a-8994-d5e8da8200a3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.198305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.198959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.199241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.199541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.200487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.201616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9eec4b096f4451a1357ed2011e00a6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.202731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.209308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9eec4b096f4451a1357ed2011e00a6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.211731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9eec4b096f4451a1357ed2011e00a6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.216954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 882/1760] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:02:59 2022] DELETE /identity/v3/users/ad9eec4b096f4451a1357ed2011e00a6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:00.325656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 879/1761] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:00.329995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.331443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.396935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1469ef1-dff0-4d27-a541-e5bcd4dde2f9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.469634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.470551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.470798 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.471301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.472002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.473975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.585569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 883/1762] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:00.588128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.598967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c7c0-5d80-469c-8be3-f595809d9966 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.603775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.605113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.605387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.605654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.606509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.608366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.620703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 880/1763] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:00.624807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.635153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d086ef-ccee-4f86-9f81-9407b37b9b46 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.639861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.640563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.640719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.641016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.650386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.650386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.652428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.655332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 884/1764] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:00.655472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.659205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.670578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910221-aabe-46a3-8f3e-bbfcda5f951f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.677317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea38-5a98-46d2-8d98-3a42a463d0db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:00.678574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.678574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.679139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.679139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] PATH_INFO: `/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.680550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fe5defcd6c40d6abf4a1feaef08c9c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.682630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.683813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:00.684813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.685097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.685376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] PATH_INFO: `/v3/projects/51dfef24afff446e9cade6410cd33263/users/7098fda427464184be5ebe4da1e2318c/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.702776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51dfef24afff446e9cade6410cd33263, user_id=7098fda427464184be5ebe4da1e2318c, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:00.705425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec48dd-bfd4-43b7-82b3-31a330a854a9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:00.809453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 885/1765] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:00 2022] PUT /identity/v3/projects/51dfef24afff446e9cade6410cd33263/users/7098fda427464184be5ebe4da1e2318c/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:00.821264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.821545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.821817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.824827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fe5defcd6c40d6abf4a1feaef08c9c', 'request_id': 'req-b6d2f3e6-8a85-4080-8856-1db9908537fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.832219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fe5defcd6c40d6abf4a1feaef08c9c', 'request_id': 'req-b6d2f3e6-8a85-4080-8856-1db9908537fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.851000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] MFA Rules not processed for user `7098fda427464184be5ebe4da1e2318c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:00.852225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.872416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fe5defcd6c40d6abf4a1feaef08c9c', 'request_id': 'req-b6d2f3e6-8a85-4080-8856-1db9908537fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.883628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] The token cache is being invalidate because project d6fe5defcd6c40d6abf4a1feaef08c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:00.884142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.884791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6d2f3e6-8a85-4080-8856-1db9908537fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:00.886926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 881/1766] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:00 2022] DELETE /identity/v3/projects/d6fe5defcd6c40d6abf4a1feaef08c9c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:00.893266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97316-86f1-4c6f-aa6d-57a2cfe60ca8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.893630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97316-86f1-4c6f-aa6d-57a2cfe60ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.894322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97316-86f1-4c6f-aa6d-57a2cfe60ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:00.898224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:00.923809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ede97316-86f1-4c6f-aa6d-57a2cfe60ca8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:00.923809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ede97316-86f1-4c6f-aa6d-57a2cfe60ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.924624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 886/1767] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:00.927877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:00.929377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:00.946063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:00.986219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 882/1768] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:00.994224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:00.994810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:00.995100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.015628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f31ce-6989-4090-b50a-dd737fac8f50 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.020190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:01.020917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.021539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.021810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.022085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.022756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.023472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:01.024617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.039689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 883/1769] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:01.040625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.056654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186bc0e-85ee-4bce-b07d-391237a38c38 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.067728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.067728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.067728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.067728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.068834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:01.069142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.071006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.085288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 884/1770] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:01.090728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.102026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df71c36-88b2-4a68-a486-4f800829046e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.108928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.109960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.110245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.110508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.111171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.116023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.181150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 887/1771] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:00 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:01.189231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.234924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 885/1772] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:01 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:01.239002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.257200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ee97-5ffd-4be6-b20b-e5de78948dea admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.332891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ccf7-0e70-4f61-a568-ef21033e954b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.338244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.339054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.342892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.347300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.347300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.347300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.372250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.378239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.378239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.378239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.378239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.379301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.471148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 886/1773] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:01 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:01.471448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 888/1774] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:01 2022] POST /identity/v3/users => generated 295 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:01.477856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.478269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.491672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0dfd-e1c7-45e1-a8cc-8b1e51e325e1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.491824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee6d14-78dd-4c6f-a9e3-68f1d0102833 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.497021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.497670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.497951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.498256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.498976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.500593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.505257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.506260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.506572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.506854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.507576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.511835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.520643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 889/1775] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:01.521805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 887/1776] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:01.524765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.526630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.533726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:01.538834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a4ad7-7d02-4c06-8b73-cc26caa3c3d7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.539218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f596-2cdf-4866-8e4d-710fddd3809a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.543512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.544117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.544238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.544394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.544671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.544817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.545084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.545391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.545493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] PATH_INFO: `/v3/projects/e4b6aee666ef4711b567042fb66b463c/users/aee61c3d858e4182b2de0f9e7a6a7c9f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.547067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.558584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 890/1777] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:01.562543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b6aee666ef4711b567042fb66b463c, user_id=aee61c3d858e4182b2de0f9e7a6a7c9f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.562656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.564368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.571959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337363b7-e2fd-4bbb-ab73-8aa703687a9b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.576977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.577614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.577887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.578156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] PATH_INFO: `/v3/projects/def4384a2764424c9ed59acd11b0f93d/users/08a35ddbf7f943aeae56151d0f45aa36/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.592883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=def4384a2764424c9ed59acd11b0f93d, user_id=08a35ddbf7f943aeae56151d0f45aa36, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.595574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0b3a-6508-4c02-99dc-ec05d704dc9d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.639574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 888/1778] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:01 2022] PUT /identity/v3/projects/e4b6aee666ef4711b567042fb66b463c/users/aee61c3d858e4182b2de0f9e7a6a7c9f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:01.643831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.679165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 891/1779] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:01 2022] PUT /identity/v3/projects/def4384a2764424c9ed59acd11b0f93d/users/08a35ddbf7f943aeae56151d0f45aa36/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:01.690921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.691407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.691849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.707172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db58bf-c6d4-49f2-b292-3a2fa991da40 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.725081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] MFA Rules not processed for user `08a35ddbf7f943aeae56151d0f45aa36`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:01.726347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:01.767916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.768531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.768810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.769078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.769723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.771402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.786738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 889/1780] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:01.789448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.799560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62477cc8-5aa2-4cd4-8fb4-db893c336234 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.804529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.805196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.805456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.805731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] PATH_INFO: `/v3/projects/e4b6aee666ef4711b567042fb66b463c/users/aee61c3d858e4182b2de0f9e7a6a7c9f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.807709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b6aee666ef4711b567042fb66b463c, user_id=aee61c3d858e4182b2de0f9e7a6a7c9f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:01.810299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5290a-ab15-4660-8ca9-5dfa51d2fcbb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:01.815624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 892/1781] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:01.824156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 890/1782] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:01 2022] PUT /identity/v3/projects/e4b6aee666ef4711b567042fb66b463c/users/aee61c3d858e4182b2de0f9e7a6a7c9f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:01.834681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.834681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:01.836127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.836455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.836790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.874694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] MFA Rules not processed for user `aee61c3d858e4182b2de0f9e7a6a7c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:01.876266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:01.893462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c12db3-3a7e-4904-9ca9-984883151e53 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.952212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.952750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.953050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.953322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:01.954386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 891/1783] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:01.965516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:01.966956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:01.979044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c2ea1-8d2b-4c56-bc68-c00786d16532 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:01.991203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:01.991203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:01.991203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:01.991203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:02.011593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:02.013012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:02.022069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 893/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:02.044640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:02.044640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550266ba-f5da-4aa2-88fd-7d3a6945ff61 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:02.048015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:02.051601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 892/1785] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:02.112062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f1c88-5204-4ced-a13a-5771fea53b29 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:02.116818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:02.117446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:02.117724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:02.117996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] PATH_INFO: `/v3/users/08a35ddbf7f943aeae56151d0f45aa36` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:02.119348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a35ddbf7f943aeae56151d0f45aa36)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:02.121824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:02.272888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:02.330852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a35ddbf7f943aeae56151d0f45aa36'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:02.386915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a35ddbf7f943aeae56151d0f45aa36'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:02.401070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a35ddbf7f943aeae56151d0f45aa36'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:02.408094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a35ddbf7f943aeae56151d0f45aa36'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:02.408934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a35ddbf7f943aeae56151d0f45aa36'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:02.414788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 894/1786] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:02 2022] DELETE /identity/v3/users/08a35ddbf7f943aeae56151d0f45aa36 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:02.419930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:02.420211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:02.420482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:02.440330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:02.441556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:02.505804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 893/1787] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:02.518571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:02.520062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:02.581529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf924ffa-b71b-430d-b771-cd434625f10a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:02.585441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:02.586272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:02.586574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:02.586848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:02.596035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:02.597522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b648f-97f2-4a81-8561-7bb3f03cfe84 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:02.607872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 895/1788] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:02.661920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:03.353772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:03.357265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:03.374433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fda66-2f86-4777-bd8f-3194943e50af None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:03.379731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:03.380796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:03.381173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:03.381550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] PATH_INFO: `/v3/projects/def4384a2764424c9ed59acd11b0f93d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:03.382869 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=def4384a2764424c9ed59acd11b0f93d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:03.388670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:03.527675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:03.556144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def4384a2764424c9ed59acd11b0f93d', 'request_id': 'req-079af84e-3469-40af-ab1e-4533d8b1e18a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:03.565655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def4384a2764424c9ed59acd11b0f93d', 'request_id': 'req-079af84e-3469-40af-ab1e-4533d8b1e18a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:03.644397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def4384a2764424c9ed59acd11b0f93d', 'request_id': 'req-079af84e-3469-40af-ab1e-4533d8b1e18a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:03.661075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] The token cache is being invalidate because project def4384a2764424c9ed59acd11b0f93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:03.661517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:03.662341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-079af84e-3469-40af-ab1e-4533d8b1e18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:03.664266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 894/1789] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:03 2022] DELETE /identity/v3/projects/def4384a2764424c9ed59acd11b0f93d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:03.669158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:03.669615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:03.669721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:03.691187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:03.692833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:03.706188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:03.797466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 896/1790] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:03.804891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:03.805450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:03.805924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:03.832808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:03.834041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:03.853172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 895/1791] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:03.860857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:03.893200 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8e6d2-31ff-4edd-857f-45579611bebd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:03.909171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:03.909975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:03.910500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:03.911013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:03.911883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:03.912448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:03.914690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:03.928893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:03.931036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:03.968880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 897/1792] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:03.973158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.006914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22cf5-3bfe-43b6-9f4c-6870f321b832 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.028508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.028508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.028508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.028508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.028861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.028861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.048336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48349ee8-9958-4681-bc4d-811f5ce96531 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.061122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.066800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.066800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.066800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.066800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:04.132724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 898/1793] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:03 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:04.134104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.156906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.158598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.181562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 896/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:04.238475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6980e-41c4-4122-84d1-4e51338015c5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.260835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.260835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.260835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.260835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.261121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.261121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.411376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 899/1795] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:04 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:04.413287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.430894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc595b2-7015-4d58-8693-804f3ce664c1 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.438622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.439259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.439554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.440045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.440756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.442379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.460068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 897/1796] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:04.467157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.490360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cc79-30b9-4edf-9d06-e8a98f1827cd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.493981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.495131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.495413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.495688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.496532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.502654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a4fc-f3ea-441c-a574-72ba12b8a386 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.534794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 900/1797] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:04.534875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.545202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e4b8-0d8d-41a5-aaea-0732528e2ed6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.551322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.552182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.552468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.552791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] PATH_INFO: `/v3/projects/1ca6f607ba8843798d53bd484c8ebb15/users/2776075f979041cea0fdf9886581b1b4/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.573687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca6f607ba8843798d53bd484c8ebb15, user_id=2776075f979041cea0fdf9886581b1b4, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:04.576775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:04.650307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 898/1798] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:04 2022] PUT /identity/v3/projects/1ca6f607ba8843798d53bd484c8ebb15/users/2776075f979041cea0fdf9886581b1b4/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:04.663377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30b6f-3f5f-42db-b09f-bd7da6a0a741 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.663679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30b6f-3f5f-42db-b09f-bd7da6a0a741 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.663973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea30b6f-3f5f-42db-b09f-bd7da6a0a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:04.732662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4ea30b6f-3f5f-42db-b09f-bd7da6a0a741 None None] MFA Rules not processed for user `2776075f979041cea0fdf9886581b1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:04.732662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4ea30b6f-3f5f-42db-b09f-bd7da6a0a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:04.840885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 901/1799] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:04.853874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:04.856713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:04.968441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e19a-fd65-4553-888f-70c9b02b60e1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:04.976158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:04.976966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:04.977428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:04.977766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:05.002845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:05.004753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963c102-25a5-4562-bdc3-8a9f0c9d8c20 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:05.027013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 899/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:05.345547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:05.621995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:06.909052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:06.910032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:06.910590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:06.913444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 902/1801] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:03:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:03:06.924442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:06.924911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:06.927807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:06.963491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:06.967358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:07.108761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 900/1802] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:03:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:07.128658 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:07.136656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:07.158358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125a7b9-9814-4c0d-8255-976477bfa255 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:07.167014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:07.167014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:07.167014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:07.167014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:07.176103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:07.177676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f32b3-14cf-4148-bd8a-10865e9d122d service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:07.188935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 903/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:07.289970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:08.126749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:09.182965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:09.185555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:09.264552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28c09-8888-4830-b20f-5f4152364ff6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:09.269233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:09.269864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:09.270142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:09.270416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] PATH_INFO: `/v3/users/7098fda427464184be5ebe4da1e2318c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:09.271700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7098fda427464184be5ebe4da1e2318c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:09.273787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:09.470381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7098fda427464184be5ebe4da1e2318c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:09.521748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7098fda427464184be5ebe4da1e2318c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:09.534157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7098fda427464184be5ebe4da1e2318c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:09.540666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7098fda427464184be5ebe4da1e2318c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:09.541909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7098fda427464184be5ebe4da1e2318c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:09.547691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 901/1804] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:09 2022] DELETE /identity/v3/users/7098fda427464184be5ebe4da1e2318c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:09.552481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:09.552928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:09.553033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:09.571331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:09.572526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:09.643878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 904/1805] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:09.661984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:09.663710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:09.747003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d448394-7136-4904-b5ed-33e4bca7d38c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:09.750986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:09.751437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:09.757157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:09.757458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:09.768352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:09.771008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:09.782967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 902/1806] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:09.806810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:09.808289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:09.824744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ef51b-eeaf-499a-bdd6-996250a315c1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:09.850714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:09.851647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:09.852142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:09.852568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] PATH_INFO: `/v3/users/2776075f979041cea0fdf9886581b1b4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:09.857303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2776075f979041cea0fdf9886581b1b4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:09.859543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.157361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:10.158805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.180657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2776075f979041cea0fdf9886581b1b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.192440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2b6ca-b643-43e2-a62f-ef8c4b13a3af service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:10.198604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:10.199592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.199923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.200250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] PATH_INFO: `/v3/users/e0aae052295e4abc850252e79ad07491` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.201593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0aae052295e4abc850252e79ad07491)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:10.204067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.253482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2776075f979041cea0fdf9886581b1b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.267954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2776075f979041cea0fdf9886581b1b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.277107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2776075f979041cea0fdf9886581b1b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.278052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b3a0cc0-5f11-4824-8161-3784a245dc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2776075f979041cea0fdf9886581b1b4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.285624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 905/1807] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:09 2022] DELETE /identity/v3/users/2776075f979041cea0fdf9886581b1b4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:10.290593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.291046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.291523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.313189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:10.314422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.379523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 906/1808] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:10.380656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:10.383832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.397503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bddf3a-8758-4f40-a1b3-95ad7eaff008 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:10.409673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:10.409673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.409673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.409673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] PATH_INFO: `/v3/projects/51dfef24afff446e9cade6410cd33263` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.414013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51dfef24afff446e9cade6410cd33263)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:10.416363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.476676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0aae052295e4abc850252e79ad07491'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.567432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0aae052295e4abc850252e79ad07491'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.580931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0aae052295e4abc850252e79ad07491'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.585228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51dfef24afff446e9cade6410cd33263', 'request_id': 'req-6699a5d8-90c8-4a62-848b-76180aa80d46'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.588661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0aae052295e4abc850252e79ad07491'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.589379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0aae052295e4abc850252e79ad07491'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.592236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51dfef24afff446e9cade6410cd33263', 'request_id': 'req-6699a5d8-90c8-4a62-848b-76180aa80d46'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.593600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:10.597946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 903/1809] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:10 2022] DELETE /identity/v3/users/e0aae052295e4abc850252e79ad07491 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:10.599349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:10.600692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.657252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12198-ec44-4017-b8e4-6c02b3651529 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:10.660825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51dfef24afff446e9cade6410cd33263', 'request_id': 'req-6699a5d8-90c8-4a62-848b-76180aa80d46'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.663589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:10.664327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.664609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.664949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.667799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.676646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] The token cache is being invalidate because project 51dfef24afff446e9cade6410cd33263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:10.677106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.677838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6699a5d8-90c8-4a62-848b-76180aa80d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:10.679646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 907/1810] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:10 2022] DELETE /identity/v3/projects/51dfef24afff446e9cade6410cd33263 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:10.681053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.681394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.681669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.704563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:10.705777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.731011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:10.732437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.742181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 904/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:10.742614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:10.743975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.756335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fecfa-b3bf-4a73-83b7-a9b60c0ddf73 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:10.761275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:10.761910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.762189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.762462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] PATH_INFO: `/v3/users/aee61c3d858e4182b2de0f9e7a6a7c9f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.763643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee61c3d858e4182b2de0f9e7a6a7c9f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:10.765543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.773327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 908/1812] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:10.783546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:10.785133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:10.798565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17867d-ef8b-467a-815d-12f5654e315e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:10.802777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:10.803226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:10.803740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:10.804193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:10.806586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:10.817803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:10.819585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:10.831424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 909/1813] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:11.073410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee61c3d858e4182b2de0f9e7a6a7c9f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.138903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee61c3d858e4182b2de0f9e7a6a7c9f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.152787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee61c3d858e4182b2de0f9e7a6a7c9f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.159779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee61c3d858e4182b2de0f9e7a6a7c9f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.160513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee61c3d858e4182b2de0f9e7a6a7c9f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.167303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 905/1814] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:10 2022] DELETE /identity/v3/users/aee61c3d858e4182b2de0f9e7a6a7c9f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:11.440341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:11.441409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:11.462787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17888b54-5acc-4129-a377-54137920b243 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:11.524446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:11.525084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:11.525365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:11.526404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] PATH_INFO: `/v3/projects/1ca6f607ba8843798d53bd484c8ebb15` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:11.529712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca6f607ba8843798d53bd484c8ebb15)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:11.531499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:11.531979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:11.540906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:11.578341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fff25-9f06-403d-950a-d84713449b73 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:11.584170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:11.586386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:11.587074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:11.590013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] PATH_INFO: `/v3/projects/79c272b32dfc465ea0ded76ad9ea0abe` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:11.591258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c272b32dfc465ea0ded76ad9ea0abe)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:11.594218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:11.684469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca6f607ba8843798d53bd484c8ebb15', 'request_id': 'req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.690920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca6f607ba8843798d53bd484c8ebb15', 'request_id': 'req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.748391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c272b32dfc465ea0ded76ad9ea0abe', 'request_id': 'req-5471ba20-c786-4c56-9996-f11a06f882ea'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.756015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c272b32dfc465ea0ded76ad9ea0abe', 'request_id': 'req-5471ba20-c786-4c56-9996-f11a06f882ea'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.781147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca6f607ba8843798d53bd484c8ebb15', 'request_id': 'req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.793572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] The token cache is being invalidate because project 1ca6f607ba8843798d53bd484c8ebb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:11.793935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.794534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f4d01892-c0d0-45c8-8b1c-9bd1dfbc5866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.796147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 910/1815] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:11 2022] DELETE /identity/v3/projects/1ca6f607ba8843798d53bd484c8ebb15 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:11.804319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:11.804716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:11.805092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:11.859906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:11.861819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:11.871754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c272b32dfc465ea0ded76ad9ea0abe', 'request_id': 'req-5471ba20-c786-4c56-9996-f11a06f882ea'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.883931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] The token cache is being invalidate because project 79c272b32dfc465ea0ded76ad9ea0abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:11.884348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.885868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:11.890886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 906/1816] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:11 2022] DELETE /identity/v3/projects/79c272b32dfc465ea0ded76ad9ea0abe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:11.892739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:11.894536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:11.933967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 911/1817] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:11.935166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:11.936521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:11.959707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99493f6d-72e1-4423-9b11-4a073a66fd2d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:11.967737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:11.974698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ba20-c786-4c56-9996-f11a06f882ea admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:11.974857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:11.974857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:11.974857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] PATH_INFO: `/v3/users/1eb34906e79a4762a9d1977e612f2f65` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:11.974857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb34906e79a4762a9d1977e612f2f65)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:11.974857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:11.975296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:11.975296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:11.975296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:11.975296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] PATH_INFO: `/v3/projects/e4b6aee666ef4711b567042fb66b463c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:11.976338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b6aee666ef4711b567042fb66b463c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:11.978387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.169271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb34906e79a4762a9d1977e612f2f65'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.169648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b6aee666ef4711b567042fb66b463c', 'request_id': 'req-a56b7588-d4a5-4c34-8e43-df7483b8333b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.176126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b6aee666ef4711b567042fb66b463c', 'request_id': 'req-a56b7588-d4a5-4c34-8e43-df7483b8333b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.235580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb34906e79a4762a9d1977e612f2f65'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.248239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb34906e79a4762a9d1977e612f2f65'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.255144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb34906e79a4762a9d1977e612f2f65'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.255815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b9e27cc-e195-4aab-a093-bd9dd8994a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb34906e79a4762a9d1977e612f2f65'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.261664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 912/1818] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:11 2022] DELETE /identity/v3/users/1eb34906e79a4762a9d1977e612f2f65 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:12.262882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.263298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.263486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.282962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:12.284179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:12.293828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b6aee666ef4711b567042fb66b463c', 'request_id': 'req-a56b7588-d4a5-4c34-8e43-df7483b8333b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.308467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] The token cache is being invalidate because project e4b6aee666ef4711b567042fb66b463c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:12.309053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.310075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a56b7588-d4a5-4c34-8e43-df7483b8333b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:12.311683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 907/1819] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:11 2022] DELETE /identity/v3/projects/e4b6aee666ef4711b567042fb66b463c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:12.316152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee988474-e190-4f81-b32e-e3bde7261050 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.316439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee988474-e190-4f81-b32e-e3bde7261050 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.316715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee988474-e190-4f81-b32e-e3bde7261050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.357888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 913/1820] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:12.362170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.362993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ee988474-e190-4f81-b32e-e3bde7261050 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:12.364596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ee988474-e190-4f81-b32e-e3bde7261050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:12.374283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb1e00-ba7c-4cfe-a6d3-2ea6f5b2dd99 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.380380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 908/1821] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:12.388415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.388836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.389174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.389433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.390126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.390512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.392748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.393594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:12.394079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.396147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.411549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 914/1822] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:12.413290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:12.417852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:12.418945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.432945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 909/1823] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:12.435896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2b83c-3531-4daa-a876-cc67e766d69f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.436021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.442039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.443599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.443599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.443963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.444937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.447189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.448175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7df6-9362-47d6-9575-f7e065e07be9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.453377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.454051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.454337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.454842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.455697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:12.456054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.458228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.483396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 910/1824] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:12.484163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.496931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c516885-32c7-492e-a402-4a09473cd786 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.502233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.502979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.503260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.503625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.504247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.506397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.575214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 915/1825] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:12.578899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.605984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 911/1826] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:12.607025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.687632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447e57-f701-4fc6-ac63-9e21e7d9fc2a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.731766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48538ae7-44d5-4564-b0f1-dccdf0c1cf9d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.737002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.737831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.738203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.738645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.739549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.741598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.769219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.770040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.770434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.770823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.771683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.774423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.791873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:12.856169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 912/1827] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:12.857902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.870835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f70b04-eee8-44ae-8aad-5a46bdcfa684 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.879091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.879827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.880204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.880572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.881329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.883059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.908710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 916/1828] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:12 2022] POST /identity/v3/users => generated 282 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:12.910784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.917071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:12.944868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 913/1829] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:12.946018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.949673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519b60-c12f-4af6-ad78-32eb1680b248 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.959442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a74a64-7909-428c-b35e-90c4dffc9a99 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:12.964890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.965596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.965896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.966177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.966857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.970511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.971520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:12.973165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:12.973902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:12.974371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] PATH_INFO: `/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:12.975816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c85e9def454bbe9948f6dbe3b2b94b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:12.978087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:12.982541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 914/1830] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:12.983533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:12.995201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0973a8d-3373-4583-b7db-1a60171774c9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.000731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.001347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.001600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.002077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.002667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.004261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.014882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 915/1831] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:13.016862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.029617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c412f-7a2c-4b69-a54d-3a78b6d2a2f6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.034400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.035084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.035369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.035639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.036276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.037838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.047781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 916/1832] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:13.048623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.058780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d9e71-4b5a-4212-994f-a09c29178060 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.063396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.064041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.064318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.064595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] PATH_INFO: `/v3/projects/c40ba223d01d4fdb9dd6186269851360/users/c2314ec5d7784351a4d976753edbe4dd/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.080978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40ba223d01d4fdb9dd6186269851360, user_id=c2314ec5d7784351a4d976753edbe4dd, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.083774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.185571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 917/1833] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:13 2022] PUT /identity/v3/projects/c40ba223d01d4fdb9dd6186269851360/users/c2314ec5d7784351a4d976753edbe4dd/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:13.186656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.193492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c85e9def454bbe9948f6dbe3b2b94b', 'request_id': 'req-a0058b5f-13b3-4949-bb39-720817229a89'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:13.201725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c85e9def454bbe9948f6dbe3b2b94b', 'request_id': 'req-a0058b5f-13b3-4949-bb39-720817229a89'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:13.258538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73628b-db1a-45b1-90ba-e770e43b2bb6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.289846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c85e9def454bbe9948f6dbe3b2b94b', 'request_id': 'req-a0058b5f-13b3-4949-bb39-720817229a89'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:13.307638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] The token cache is being invalidate because project e2c85e9def454bbe9948f6dbe3b2b94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:13.308236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:13.309300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0058b5f-13b3-4949-bb39-720817229a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:13.311272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 917/1834] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:12 2022] DELETE /identity/v3/projects/e2c85e9def454bbe9948f6dbe3b2b94b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:13.312818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7a87-74cc-4eea-b0b0-5fc3c506aa30 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.313188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7a87-74cc-4eea-b0b0-5fc3c506aa30 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.313524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7a87-74cc-4eea-b0b0-5fc3c506aa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.335936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.339440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.339440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.339440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] PATH_INFO: `/v3/projects/ed74bcbacd444b93896520a8f21388f3/users/60504469d6624f208889df69b24236be/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.359511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8fff7a87-74cc-4eea-b0b0-5fc3c506aa30 None None] MFA Rules not processed for user `c2314ec5d7784351a4d976753edbe4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:13.360301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed74bcbacd444b93896520a8f21388f3, user_id=60504469d6624f208889df69b24236be, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.360723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8fff7a87-74cc-4eea-b0b0-5fc3c506aa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.363501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5b3b9-d8be-4396-a1fd-06798f7b64ee admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.430727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 918/1835] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:13.432700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.432996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.433273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.453335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:13.454592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.463228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 919/1836] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:13.471425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.472836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.485181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fb4b-7113-46ed-a0ec-380e5b34723d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.491088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.491789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.492357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.492705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.496034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.497291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.514975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 918/1837] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:13 2022] PUT /identity/v3/projects/ed74bcbacd444b93896520a8f21388f3/users/60504469d6624f208889df69b24236be/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:13.516737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23a7f-3ec3-4639-bf11-81e58083f396 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.517203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23a7f-3ec3-4639-bf11-81e58083f396 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.517554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23a7f-3ec3-4639-bf11-81e58083f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.542058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f5e23a7f-3ec3-4639-bf11-81e58083f396 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:13.543323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f5e23a7f-3ec3-4639-bf11-81e58083f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.599619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 919/1838] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:13.600847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.601127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.601396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.612615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 920/1839] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:13.614005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.630724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] MFA Rules not processed for user `60504469d6624f208889df69b24236be`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:13.631953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.662201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:13.674305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671315c-cd1e-4273-9f8a-180f140b6e4a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.679100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.679799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.680082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.680350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.680992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:13.681411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.683564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.694910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 921/1840] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:13.695686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.698437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 920/1841] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:13.699183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.712895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49edfc-4fbf-4a4e-85b1-a06c44c9873a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.717738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.718357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.718677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.718952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.721383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.721745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.724866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817aa77-65e2-4e61-9945-c761ad7bea4f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.730854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.733513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.733814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.734192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.734902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.736932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.840613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 922/1842] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:13.841703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.843900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:13.849706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 921/1843] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:13.849706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.927893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc5c50-fd99-4189-a2c0-d0f319e2333e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.949478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719fbe-8483-481e-95db-08bc789f4fc2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:13.961056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:13.961772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:13.962013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:13.962285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:13.963518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:13.965296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:13.980972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 922/1844] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:13.982062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:13.993659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7200268-6fb6-4432-838c-3c58bfcb9e8d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.003191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.003901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.004271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.004609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.005417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.007759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.013256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.014252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.014717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.014902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.089047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.090653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.102089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 923/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:14.104509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.113156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 923/1846] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:13 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:14.117234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.125344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c7ff-ed68-4835-9019-2c0be154d057 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.131315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e890-b9cf-4801-bb1b-191d4d5d25bd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.132734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.133552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.133976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.134430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] PATH_INFO: `/v3/projects/2e30ec98725646b4853cb7a226c04516/users/6c57efe2f1a64383a74a6502dc3f6d66/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.138229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.140002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.140469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.141014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.141864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.143915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.155852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e30ec98725646b4853cb7a226c04516, user_id=6c57efe2f1a64383a74a6502dc3f6d66, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.159911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.163872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 924/1847] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:14.164209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.175723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f9d2e-9071-4b88-b5d7-77ae99ae569d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.181463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.182219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.182828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.183205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.184031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.197837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.220397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 925/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:14.243139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.267554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7f47-72f4-4870-810b-7868fe529026 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.272017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.272699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.272980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.273252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] PATH_INFO: `/v3/projects/51a473278354444ebaf81aad6013c468/users/0fc1d2fba7484530ac0fe60d1ec0667b/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.288194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 924/1849] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:14 2022] PUT /identity/v3/projects/2e30ec98725646b4853cb7a226c04516/users/6c57efe2f1a64383a74a6502dc3f6d66/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:14.291809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a473278354444ebaf81aad6013c468, user_id=0fc1d2fba7484530ac0fe60d1ec0667b, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.294552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4892-c1f1-4dbf-a32e-27197fef54a0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.300142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.371178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 926/1850] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:14 2022] PUT /identity/v3/projects/51a473278354444ebaf81aad6013c468/users/0fc1d2fba7484530ac0fe60d1ec0667b/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:14.381311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.381623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.381858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.444277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610611c-1156-4ea1-a613-8029d7905fed admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.451493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] MFA Rules not processed for user `0fc1d2fba7484530ac0fe60d1ec0667b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:14.452737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:14.562846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.565028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.565171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.565400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.569099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.573815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.596596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 925/1851] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:14.598409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.623384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4dfb-1939-4b69-9adb-c88e3a6be1b0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.631911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.633331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.633613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.633887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] PATH_INFO: `/v3/projects/2e30ec98725646b4853cb7a226c04516/users/6c57efe2f1a64383a74a6502dc3f6d66/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.637050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 927/1852] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:14.645218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.645713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e30ec98725646b4853cb7a226c04516, user_id=6c57efe2f1a64383a74a6502dc3f6d66, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.649984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ca94a-5c86-4c90-bb79-a8c7ea6981b5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.667708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16cfe-8ee0-4fa0-a593-7e7856424f3a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:14.676916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 926/1853] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:14 2022] PUT /identity/v3/projects/2e30ec98725646b4853cb7a226c04516/users/6c57efe2f1a64383a74a6502dc3f6d66/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:14.690393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.690750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.691938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.733091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] MFA Rules not processed for user `6c57efe2f1a64383a74a6502dc3f6d66`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:14.735031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:14.797825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:14.801600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:14.801999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:14.802373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:14.803358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:14.807579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:14.844997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 927/1854] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:14.934275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:14.956088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 928/1855] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:14 2022] POST /identity/v3/projects => generated 381 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:14.961928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.009501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0337c-a1ff-4bd1-912f-e427e4c92807 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.061429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7613d-85cf-477b-9348-56b329fbc88d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.066771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.067467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.067834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.068174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.068926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.070978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.082449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.083133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.083443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.083688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.161410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.162795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.170807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 929/1856] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:14 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:15.175307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 928/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:15.175715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.185555 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee10c-5c47-404f-a414-30ff9d43ab88 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.190595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.191434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.191713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.192041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.193242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.194310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.205879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 930/1858] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:15.210269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.221433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1c73-edd0-4c6e-a1fd-00906b02af23 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.226934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.232668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.232668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.232668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] PATH_INFO: `/v3/projects/e85b334138f44d6dad5755431b60245b/users/a25f07aeb7a24b85a219500b3d2053d2/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.243433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85b334138f44d6dad5755431b60245b, user_id=a25f07aeb7a24b85a219500b3d2053d2, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.248770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.332523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 929/1859] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:15 2022] PUT /identity/v3/projects/e85b334138f44d6dad5755431b60245b/users/a25f07aeb7a24b85a219500b3d2053d2/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:15.336646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.358453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fba62c-1cd1-4650-b23c-441fb859ec47 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.423756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.424435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.424776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.425047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.425967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.427580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.446965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 931/1860] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:15.452275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.455075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.475408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99666bc-465a-45a9-8b82-5efea54c107d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.485995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.486706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.486988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.487317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] PATH_INFO: `/v3/projects/e85b334138f44d6dad5755431b60245b/users/a25f07aeb7a24b85a219500b3d2053d2/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.489520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85b334138f44d6dad5755431b60245b, user_id=a25f07aeb7a24b85a219500b3d2053d2, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.492358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370d60-783c-40e4-94ed-58d59d0d6c9e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.505717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 930/1861] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:15 2022] PUT /identity/v3/projects/e85b334138f44d6dad5755431b60245b/users/a25f07aeb7a24b85a219500b3d2053d2/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:15.518144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.519037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.519656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.528342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f6ba-3182-4fd4-8e8c-88bbbe9c3981 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.548883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] MFA Rules not processed for user `a25f07aeb7a24b85a219500b3d2053d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:15.550123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:15.577831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.578463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.578774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.579043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.628466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 931/1862] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:15.642020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.643549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:15.649836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.652216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.655695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7952512-061f-4e66-a19c-89b5912d73d9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.659605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.660224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.660546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.660819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.661463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 932/1863] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:15.676782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.678471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.689855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 932/1864] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:15.730951 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:15.798443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:15.807799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d47b7-a14e-4559-a65d-ccdf69e45a49 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:15.811518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:15.812201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:15.812464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:15.812770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:15.875128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:15.877198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb184bad-f7cb-446b-b23a-63800add6e6d service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:15.886879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 933/1865] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:16.630856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:17.344364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:17.345928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:17.423342 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2692-3342-42bb-a0d5-c17f0e880f3b service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:17.430036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:17.430734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:17.431021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:17.431299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] PATH_INFO: `/v3/users/d6f93b57456342778a788036406ad4e2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:17.433008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f93b57456342778a788036406ad4e2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:17.434996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:17.645469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f93b57456342778a788036406ad4e2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:17.704799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f93b57456342778a788036406ad4e2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:17.721915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f93b57456342778a788036406ad4e2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:17.729655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f93b57456342778a788036406ad4e2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:17.730391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f93b57456342778a788036406ad4e2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:17.745613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 933/1866] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:17 2022] DELETE /identity/v3/users/d6f93b57456342778a788036406ad4e2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:17.754865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:17.756331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:17.756936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:17.797052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:17.798258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:17.898828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 934/1867] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:17.940904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:17.942475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:18.017063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e94fde-dfbc-4018-998a-87717d2416e8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:18.020683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:18.021364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:18.021733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:18.022075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:18.031942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:18.033377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:18.043510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 934/1868] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:18.803874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:19.059125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:19.060920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:19.076714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52d437-98e0-4af4-a925-ac5dbdc315f4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:19.084052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:19.085143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:19.085616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:19.086599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] PATH_INFO: `/v3/projects/4ce401f42fa643ccbefcfd8f4c5387a1` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:19.088131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce401f42fa643ccbefcfd8f4c5387a1)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:19.091511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:19.225390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce401f42fa643ccbefcfd8f4c5387a1', 'request_id': 'req-fda1d1a0-3475-4593-a7e1-d697a93d41fe'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.233494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce401f42fa643ccbefcfd8f4c5387a1', 'request_id': 'req-fda1d1a0-3475-4593-a7e1-d697a93d41fe'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.333218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce401f42fa643ccbefcfd8f4c5387a1', 'request_id': 'req-fda1d1a0-3475-4593-a7e1-d697a93d41fe'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.357806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] The token cache is being invalidate because project 4ce401f42fa643ccbefcfd8f4c5387a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:19.363746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.363746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.363746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 935/1869] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:19 2022] DELETE /identity/v3/projects/4ce401f42fa643ccbefcfd8f4c5387a1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:19.365257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:19.376868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b6973-2908-4ac7-b418-7c42149a5c54 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:19.515660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:19.517340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:19.591361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:19.592301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:19.592726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:19.593141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] PATH_INFO: `/v3/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:19.596154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fbc0e4dc4c4efa8ab7b7ec0e140f34)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:19.598756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:19.613931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1d1a0-3475-4593-a7e1-d697a93d41fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:19.618395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:19.619240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:19.619641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:19.619993 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] PATH_INFO: `/v3/users/0fc1d2fba7484530ac0fe60d1ec0667b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:19.621349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc1d2fba7484530ac0fe60d1ec0667b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:19.623440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:19.632215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:19.834743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc1d2fba7484530ac0fe60d1ec0667b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.861289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fbc0e4dc4c4efa8ab7b7ec0e140f34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.939799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc1d2fba7484530ac0fe60d1ec0667b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.955492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc1d2fba7484530ac0fe60d1ec0667b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.965905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc1d2fba7484530ac0fe60d1ec0667b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.966437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-88239224-c468-4104-bcf7-e02c4986ecc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc1d2fba7484530ac0fe60d1ec0667b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:19.978403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 936/1870] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:19 2022] DELETE /identity/v3/users/0fc1d2fba7484530ac0fe60d1ec0667b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:19.980551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:19.981028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:19.981308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:20.015890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:20.017132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:20.027127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fbc0e4dc4c4efa8ab7b7ec0e140f34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:20.047222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fbc0e4dc4c4efa8ab7b7ec0e140f34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:20.061823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fbc0e4dc4c4efa8ab7b7ec0e140f34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:20.062597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fbc0e4dc4c4efa8ab7b7ec0e140f34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:20.071934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 935/1871] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:19 2022] DELETE /identity/v3/users/39fbc0e4dc4c4efa8ab7b7ec0e140f34 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:20.113649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 937/1872] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:20.139446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:20.141322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:20.249385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7559b-44b6-43fd-ad78-25e4407e079b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:20.253208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:20.254010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:20.254266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:20.254564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:20.334786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:20.336230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:20.349034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 936/1873] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:20.688130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:20.971836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:20.973318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:21.010982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c02d0a-f216-4e46-8a75-1936bc6b1e10 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.030287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.031220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.031647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.032091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] PATH_INFO: `/v3/projects/dcb8b33d81ca4d878ac27ceba4446355` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.035329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb8b33d81ca4d878ac27ceba4446355)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.037493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:21.220657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb8b33d81ca4d878ac27ceba4446355', 'request_id': 'req-10bc4fa6-c2d7-4675-8405-999a4ab04041'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.228295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb8b33d81ca4d878ac27ceba4446355', 'request_id': 'req-10bc4fa6-c2d7-4675-8405-999a4ab04041'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.310852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:21.313690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:21.341374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb8b33d81ca4d878ac27ceba4446355', 'request_id': 'req-10bc4fa6-c2d7-4675-8405-999a4ab04041'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.355272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:21.359259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753670-7c99-4289-81c3-82bfd783db9b service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.387776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] The token cache is being invalidate because project dcb8b33d81ca4d878ac27ceba4446355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:21.387776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.387776 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-10bc4fa6-c2d7-4675-8405-999a4ab04041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.388285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 938/1874] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:20 2022] DELETE /identity/v3/projects/dcb8b33d81ca4d878ac27ceba4446355 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:21.393517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea233e9-1e86-4c62-9c69-6c2215c2d182 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.393810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea233e9-1e86-4c62-9c69-6c2215c2d182 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.394086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea233e9-1e86-4c62-9c69-6c2215c2d182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.431401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0ea233e9-1e86-4c62-9c69-6c2215c2d182 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:21.432930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0ea233e9-1e86-4c62-9c69-6c2215c2d182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:21.528256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.529027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.529886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.529886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] PATH_INFO: `/v3/projects/51a473278354444ebaf81aad6013c468` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.531278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a473278354444ebaf81aad6013c468)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.533365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:21.565412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 939/1875] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:21.574361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.574913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.575344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.611573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:21.613515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:21.622771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 940/1876] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:21.627961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:21.638803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26122-c181-4d5a-8091-034cf99cb3a2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.645155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.646441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.647288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.647815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.648734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:21.649234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.652007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:21.670446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 941/1877] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:21.671850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:21.682902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184b066-0a18-4575-8715-4838eac3c13b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.689078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.689729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.693806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.693806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.693806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.693806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:21.746644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a473278354444ebaf81aad6013c468', 'request_id': 'req-72f19231-1d2a-4885-959f-d6015e335c45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.758836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a473278354444ebaf81aad6013c468', 'request_id': 'req-72f19231-1d2a-4885-959f-d6015e335c45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.824154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 942/1878] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:21 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:21.828604 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:21.844374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a473278354444ebaf81aad6013c468', 'request_id': 'req-72f19231-1d2a-4885-959f-d6015e335c45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.859463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] The token cache is being invalidate because project 51a473278354444ebaf81aad6013c468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:21.859947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.861630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:21.865758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 937/1879] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:21 2022] DELETE /identity/v3/projects/51a473278354444ebaf81aad6013c468 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:21.871118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:21.872907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:21.970739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2918b-739a-416c-8413-7b50a887cd79 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.977308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.978701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.979167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.979838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.980881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.984139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:21.985746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19231-1d2a-4885-959f-d6015e335c45 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:21.991674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:21.992320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:21.992722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:21.993120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] PATH_INFO: `/v3/users/a25f07aeb7a24b85a219500b3d2053d2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:21.994408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25f07aeb7a24b85a219500b3d2053d2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:21.997438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.074890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 943/1880] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:21 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:22.079057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.082251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:22.096709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea322a-d1b9-4cfa-acda-71871e45061f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.101856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.102812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.103271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.103568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.104383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.106108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.117329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 944/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:22.126595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.138491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0495-f0ef-4a31-9a53-4a2e558348f8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.144450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.145465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.146046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.146550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.147655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.149763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.165132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 945/1882] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:22.171559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.186690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3f2c2-5cdc-42ea-bc7c-24503611de5a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.192312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.193309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.193829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.194717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] PATH_INFO: `/v3/projects/ee639d12d47348b48d2f3e1b090bdac7/users/5ec3211e0e304d7791018193996f4ed8/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.208183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25f07aeb7a24b85a219500b3d2053d2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:22.213102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee639d12d47348b48d2f3e1b090bdac7, user_id=5ec3211e0e304d7791018193996f4ed8, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.217956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498c5a1-21d6-42ab-bf09-44f386b1ff1f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.310249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25f07aeb7a24b85a219500b3d2053d2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:22.316320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 946/1883] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:22 2022] PUT /identity/v3/projects/ee639d12d47348b48d2f3e1b090bdac7/users/5ec3211e0e304d7791018193996f4ed8/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:22.324998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25f07aeb7a24b85a219500b3d2053d2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:22.327160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.327650 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.328134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.334405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25f07aeb7a24b85a219500b3d2053d2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:22.335300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25f07aeb7a24b85a219500b3d2053d2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:22.352096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 938/1884] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:21 2022] DELETE /identity/v3/users/a25f07aeb7a24b85a219500b3d2053d2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:22.360761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] MFA Rules not processed for user `5ec3211e0e304d7791018193996f4ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:22.365892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:22.483704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 947/1885] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:22.486431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.487998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:22.591873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fee0c-b5ce-4025-a345-d0dd724f5cdf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.598248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.599015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.599540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.599887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.600666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.602905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.738439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 939/1886] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:22 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:22.739826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.760905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8e3fc-34ec-42ee-9c0a-5dec148c0f20 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.804419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:22.843320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.843846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.844610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.844805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.845462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.847438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.950068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 948/1887] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:22 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:22.950708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:22.961617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b14f6-c4cb-41e4-974a-02fcae23c142 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:22.971245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:22.974919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:22.975206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:22.975527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:22.976810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:22.980598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:22.993509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 940/1888] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:22.998017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.008103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a9f0-ac43-49df-afd9-04788c795ed8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.013017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.013803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.014174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.014598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] PATH_INFO: `/v3/projects/04169d45387b4fdd9cfe567e504a4a96/users/91797aa7bc9542d6979e28642aeff51a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.021142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.024287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.046672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=04169d45387b4fdd9cfe567e504a4a96, user_id=91797aa7bc9542d6979e28642aeff51a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.051702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.059166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e95b0a-abf9-4815-a995-9bbd3f3a4b3f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.069972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.069972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.069972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.069972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] PATH_INFO: `/v3/projects/e85b334138f44d6dad5755431b60245b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.070328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85b334138f44d6dad5755431b60245b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.070328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.187324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 949/1889] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:22 2022] PUT /identity/v3/projects/04169d45387b4fdd9cfe567e504a4a96/users/91797aa7bc9542d6979e28642aeff51a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:23.191022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.198896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85b334138f44d6dad5755431b60245b', 'request_id': 'req-e0175628-ee7b-42e3-9b98-8933e1724bd7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:23.209163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85b334138f44d6dad5755431b60245b', 'request_id': 'req-e0175628-ee7b-42e3-9b98-8933e1724bd7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:23.256920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813c80-b4d4-4ecf-b29b-be223f5b3cec admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.286168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85b334138f44d6dad5755431b60245b', 'request_id': 'req-e0175628-ee7b-42e3-9b98-8933e1724bd7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:23.301280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] The token cache is being invalidate because project e85b334138f44d6dad5755431b60245b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:23.301591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:23.302284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e0175628-ee7b-42e3-9b98-8933e1724bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:23.307236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 941/1890] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:23 2022] DELETE /identity/v3/projects/e85b334138f44d6dad5755431b60245b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:23.308855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ea64-da99-4a4c-88ba-77ed08626923 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.311163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ea64-da99-4a4c-88ba-77ed08626923 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.311163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245ea64-da99-4a4c-88ba-77ed08626923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.325914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.326556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.326843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.327121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.328041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.330102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.331182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6245ea64-da99-4a4c-88ba-77ed08626923 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:23.334248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6245ea64-da99-4a4c-88ba-77ed08626923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.344245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 950/1891] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:23.348132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:23.349267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.351027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.354585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 942/1892] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:23.360730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.361018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.361291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.363955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc06120-2b72-44db-95d6-14d7c609728f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.368460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.369148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.369409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.369678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] PATH_INFO: `/v3/projects/04169d45387b4fdd9cfe567e504a4a96/users/91797aa7bc9542d6979e28642aeff51a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.371657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04169d45387b4fdd9cfe567e504a4a96, user_id=91797aa7bc9542d6979e28642aeff51a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.374368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f41cc7-9813-4022-a25a-51dbfcb4fb6e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.379969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:23.381162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.385266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 951/1893] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:23 2022] PUT /identity/v3/projects/04169d45387b4fdd9cfe567e504a4a96/users/91797aa7bc9542d6979e28642aeff51a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:23.396728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.397012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.397338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.426570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] MFA Rules not processed for user `91797aa7bc9542d6979e28642aeff51a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:23.427768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.441547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 943/1894] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:23.445207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.465967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b678f-5aa5-498a-813e-ad58469b9106 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.473395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.474657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.474657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.474848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.475912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:23.476221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.477811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.493002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 944/1895] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:23.496965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.507792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434be7bd-ea23-4738-b028-7b942fa49193 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.513275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.514174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.514174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.514476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.515107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.517182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.517452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 952/1896] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:23.529938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.531378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.592092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2149-ddc4-49eb-adcd-0323cce00ee8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.596525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.597139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.597391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.597678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.606969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.608386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.617861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 953/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:23.641783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 945/1898] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:23 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:23.643370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.653584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b50a-888b-4b9b-9d21-54b9461450a3 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.709612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.710035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.710391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.710694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.711823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.713277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.828972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 954/1899] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:23 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:23.830142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.839466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.840739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c18f-6e99-4c77-9040-416feca85e20 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.846148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.846802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.847110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.847591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.848334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.849956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.860283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 946/1900] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:23.864158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.874091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefa2e-8e50-4e8d-9182-aa7ef2949880 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.878972 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.879564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.882397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.882397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.882397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.882397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.892690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 947/1901] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:23.894991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec15224-68a7-4af8-81e7-088d2a2b43b5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.896640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:23.899489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.900132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.900470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.905361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.905361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:23.906316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf1d77-2566-48b9-aa07-195a20a91d8d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:23.911080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:23.911733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:23.912078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:23.912361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] PATH_INFO: `/v3/projects/c6b6e1a843034087b52be63d4da9af30/users/61c94e2de82f491c8bbd43771079c59a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:23.927452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b6e1a843034087b52be63d4da9af30, user_id=61c94e2de82f491c8bbd43771079c59a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.930173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.969298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:23.971059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e539-eb2e-4501-a545-d76541899c68 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:23.980513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 955/1902] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:24.043924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 948/1903] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:23 2022] PUT /identity/v3/projects/c6b6e1a843034087b52be63d4da9af30/users/61c94e2de82f491c8bbd43771079c59a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:24.054529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.054902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.055240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.085762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] MFA Rules not processed for user `61c94e2de82f491c8bbd43771079c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:24.086924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:24.157674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 956/1904] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:24.164065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.234541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931e0a8-1118-4b13-99be-6e1529e6ce26 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.239429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.240039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.240321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.240596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.241283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.243231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.338407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 949/1905] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:24 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:24.342335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.357164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6ea48-5754-4d72-8e81-326a773bbf76 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.423254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.423864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.424141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.424406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.425071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.427294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.516600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:24.547320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 957/1906] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:24 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:24.551338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.563236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3017348-e2b7-42ec-9529-e82f79ad4db0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.567898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.568720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.568822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.569084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.569677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.571294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.586550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 950/1907] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:24.600488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.612155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32d12-c02c-4771-9206-d203bc354baa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.617991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.618343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.618719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.619022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] PATH_INFO: `/v3/projects/f268077ba40b45a3a78b3f1e20b735c3/users/cd27049a8fd7450991e03b58fdb521be/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.635149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f268077ba40b45a3a78b3f1e20b735c3, user_id=cd27049a8fd7450991e03b58fdb521be, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.637850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.684126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:24.685402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.687202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:24.699996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f39c-a68c-4d82-ac33-81061e278755 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.704623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.705254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.705537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.705811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] PATH_INFO: `/v3/users/c2314ec5d7784351a4d976753edbe4dd` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.706992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2314ec5d7784351a4d976753edbe4dd)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.708886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.724788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 958/1908] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:24 2022] PUT /identity/v3/projects/f268077ba40b45a3a78b3f1e20b735c3/users/cd27049a8fd7450991e03b58fdb521be/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:24.729161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.790822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f68cb-fc63-4889-9859-12fdb802dfca admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.795817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.796462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.796793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.797102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.797754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.799512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.809723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 959/1909] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:24.813693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.824812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ce7-b738-4823-b3f0-9ba388a8cb2a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:24.830161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:24.830894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.831136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.831406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] PATH_INFO: `/v3/projects/f268077ba40b45a3a78b3f1e20b735c3/users/cd27049a8fd7450991e03b58fdb521be/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.833374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f268077ba40b45a3a78b3f1e20b735c3, user_id=cd27049a8fd7450991e03b58fdb521be, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:24.836025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae7484-d4f1-4d23-9976-478bb91cd69d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:24.864556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 960/1910] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:24 2022] PUT /identity/v3/projects/f268077ba40b45a3a78b3f1e20b735c3/users/cd27049a8fd7450991e03b58fdb521be/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:24.864556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:24.864556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:24.864556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:24.890027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] MFA Rules not processed for user `cd27049a8fd7450991e03b58fdb521be`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:24.891272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:24.958679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 961/1911] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:24.969986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:24.971382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:24.991928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2314ec5d7784351a4d976753edbe4dd'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:25.031956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d360c3-85dd-4fa0-b766-15eaaf1f9850 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:25.035476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:25.036118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:25.036399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:25.036656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:25.046550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:25.047983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08910660-4005-496e-b114-10bdcfee3e91 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:25.057563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 962/1912] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:25.066782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2314ec5d7784351a4d976753edbe4dd'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:25.084586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2314ec5d7784351a4d976753edbe4dd'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:25.092977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2314ec5d7784351a4d976753edbe4dd'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:25.094016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2314ec5d7784351a4d976753edbe4dd'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:25.100339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 951/1913] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:24 2022] DELETE /identity/v3/users/c2314ec5d7784351a4d976753edbe4dd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:25.104861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:25.105141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:25.105407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:25.125422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:25.126585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:25.190449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 963/1914] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:25.209989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:25.211084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:25.386758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0fb5c-dc9d-4698-97ae-5563f0015a3f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:25.409821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:25.410496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:25.410812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:25.412335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:25.441651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:25.442594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:25.444115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:25.464741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 952/1915] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:25.512308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:26.008633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:26.010043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:26.022898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776338a-7995-470f-bf40-bb49a98adf6e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:26.028955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:26.030857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:26.030857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:26.031101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] PATH_INFO: `/v3/projects/c40ba223d01d4fdb9dd6186269851360` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:26.032329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40ba223d01d4fdb9dd6186269851360)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:26.039528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:26.156213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40ba223d01d4fdb9dd6186269851360', 'request_id': 'req-8fda1731-2bd1-4aab-be82-679ec088e40d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.162751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40ba223d01d4fdb9dd6186269851360', 'request_id': 'req-8fda1731-2bd1-4aab-be82-679ec088e40d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.194177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:26.195622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:26.208489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111e68a-be6c-4731-a93e-d24fa995967d service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:26.232042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40ba223d01d4fdb9dd6186269851360', 'request_id': 'req-8fda1731-2bd1-4aab-be82-679ec088e40d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.247538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] The token cache is being invalidate because project c40ba223d01d4fdb9dd6186269851360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:26.247842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.249177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.253695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 964/1916] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:26 2022] DELETE /identity/v3/projects/c40ba223d01d4fdb9dd6186269851360 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:26.257474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:26.260535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:26.288117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:26.288834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:26.289121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:26.289390 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] PATH_INFO: `/v3/users/61c94e2de82f491c8bbd43771079c59a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:26.290530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c94e2de82f491c8bbd43771079c59a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:26.292548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:26.352439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1731-2bd1-4aab-be82-679ec088e40d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:26.357089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:26.358013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:26.358496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:26.359117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] PATH_INFO: `/v3/users/6c57efe2f1a64383a74a6502dc3f6d66` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:26.360921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c57efe2f1a64383a74a6502dc3f6d66)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:26.365871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:26.432379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:26.483746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:26.498583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c94e2de82f491c8bbd43771079c59a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.577628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c57efe2f1a64383a74a6502dc3f6d66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.592079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c94e2de82f491c8bbd43771079c59a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.609294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c94e2de82f491c8bbd43771079c59a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.622156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c94e2de82f491c8bbd43771079c59a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.623205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-94b2ee28-8a61-4c62-ab78-c50a29e37951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c94e2de82f491c8bbd43771079c59a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.631867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 953/1917] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:26 2022] DELETE /identity/v3/users/61c94e2de82f491c8bbd43771079c59a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:26.636607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:26.636893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:26.637168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:26.652588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c57efe2f1a64383a74a6502dc3f6d66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.655543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:26.656750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:26.666654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c57efe2f1a64383a74a6502dc3f6d66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.673432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c57efe2f1a64383a74a6502dc3f6d66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.674188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c57efe2f1a64383a74a6502dc3f6d66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:26.680672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 965/1918] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:26 2022] DELETE /identity/v3/users/6c57efe2f1a64383a74a6502dc3f6d66 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:26.723101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 954/1919] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:26.745430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:26.745430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:26.814290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1e9ad-0ba1-4034-8ce7-7599ed9ba0d5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:26.818285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:26.818975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:26.819401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:26.819591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:26.899415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:26.901741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:26.914911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 966/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:27.143057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.144660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.158173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41a60-df85-4730-ad74-d99dd5977b5d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:27.163631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:27.164421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.164703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.165197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] PATH_INFO: `/v3/projects/2e30ec98725646b4853cb7a226c04516` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.167053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e30ec98725646b4853cb7a226c04516)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:27.174549 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:27.306952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:27.329872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e30ec98725646b4853cb7a226c04516', 'request_id': 'req-6805fd90-8b9b-4c01-ba44-dd483e7c681d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.336373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e30ec98725646b4853cb7a226c04516', 'request_id': 'req-6805fd90-8b9b-4c01-ba44-dd483e7c681d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.387905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:27.401570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.403128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.432708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6f702-04a8-4b91-a72f-9d826a0b104a service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:27.448229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e30ec98725646b4853cb7a226c04516', 'request_id': 'req-6805fd90-8b9b-4c01-ba44-dd483e7c681d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.464530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] The token cache is being invalidate because project 2e30ec98725646b4853cb7a226c04516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:27.464829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.465485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6805fd90-8b9b-4c01-ba44-dd483e7c681d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.467367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 955/1921] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:27 2022] DELETE /identity/v3/projects/2e30ec98725646b4853cb7a226c04516 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:27.473567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bae50-2d45-40e9-8326-91b9d7bc3d50 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.473858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bae50-2d45-40e9-8326-91b9d7bc3d50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.474134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bae50-2d45-40e9-8326-91b9d7bc3d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.496747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-169bae50-2d45-40e9-8326-91b9d7bc3d50 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:27.498680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-169bae50-2d45-40e9-8326-91b9d7bc3d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.516892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:27.517548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.517824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.518144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] PATH_INFO: `/v3/projects/c6b6e1a843034087b52be63d4da9af30` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.519312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b6e1a843034087b52be63d4da9af30)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:27.522367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:27.580579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 956/1922] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:27.589623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.589912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.590221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.613285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:27.614481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.623129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 957/1923] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:27.627424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.636802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec366bf0-6baa-4f8e-bdea-ab35bcc8960e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:27.641444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:27.642032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.642314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.642688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.643404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:27.643713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:27.645279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:27.658382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 958/1924] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:27.667501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.673456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b6e1a843034087b52be63d4da9af30', 'request_id': 'req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.680341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b6e1a843034087b52be63d4da9af30', 'request_id': 'req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.680747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1977-3b4d-43a1-a009-6e2800b805a6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:27.744645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:27.745292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.745628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.745903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.748157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:27.750438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:27.797375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b6e1a843034087b52be63d4da9af30', 'request_id': 'req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.818223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] The token cache is being invalidate because project c6b6e1a843034087b52be63d4da9af30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:27.818551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.819210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:27.820942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 967/1925] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:27 2022] DELETE /identity/v3/projects/c6b6e1a843034087b52be63d4da9af30 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:27.824742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.826086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.838803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84b34-6e01-4a8b-888d-d66b4f1d72fc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:27.843619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:27.844251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:27.844535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:27.844816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] PATH_INFO: `/v3/users/cd27049a8fd7450991e03b58fdb521be` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:27.845959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd27049a8fd7450991e03b58fdb521be)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:27.848057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:27.919723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 959/1926] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:27 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:27.923945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:27.925838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:27.991730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c790a5-096f-4799-a597-102d19afbe60 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.001048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.001677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.002293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.002612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.003248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.005436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:28.113630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 960/1927] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:27 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:28.115642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.119850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd27049a8fd7450991e03b58fdb521be'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:28.132198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136103fe-985c-46a0-ac85-0dccb05fd5b0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.138405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.141382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.141382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.141382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.141382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.143001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:28.155932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 961/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:28.159891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.170119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dede75-f3af-46d2-8033-7c901c613904 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.174724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.175305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.175857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.176128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.176813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.178397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:28.190389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 962/1929] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:28.194171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.203785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f6684-b6bf-4170-8629-38085dd6bd6b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.208404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.208695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd27049a8fd7450991e03b58fdb521be'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:28.209031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.209313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.209589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] PATH_INFO: `/v3/projects/61751f6414004fd8a2c7c84b55f8ff04/users/d5296715f28d478188813dbf0948d1b3/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.222154 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd27049a8fd7450991e03b58fdb521be'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:28.224600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61751f6414004fd8a2c7c84b55f8ff04, user_id=d5296715f28d478188813dbf0948d1b3, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.227274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:28.230110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd27049a8fd7450991e03b58fdb521be'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:28.230931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3da037de-1485-44be-8761-44c44f4d4e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd27049a8fd7450991e03b58fdb521be'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:28.237439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 968/1930] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:27 2022] DELETE /identity/v3/users/cd27049a8fd7450991e03b58fdb521be => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:28.322120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:28.328779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 963/1931] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:28 2022] PUT /identity/v3/projects/61751f6414004fd8a2c7c84b55f8ff04/users/d5296715f28d478188813dbf0948d1b3/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:28.339591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.339907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.340186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.368354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] MFA Rules not processed for user `d5296715f28d478188813dbf0948d1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:28.369561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:28.432882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 969/1932] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:28.437392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.439143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:28.509429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd3a-5365-442f-bd5c-c66380825b9a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.516893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.517914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.518354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.518813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.519840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.521976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:28.893592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 964/1933] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:28 2022] POST /identity/v3/projects => generated 383 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:28.893718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.900534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eb91e-9e0e-49c5-9e87-6048d653ebb2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:28.929958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:28.931838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:28.993578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:28.994364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:28.994779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:28.995183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:28.995942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:28.998744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.050360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816752-f6d0-463c-b825-7bacd96ca43c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.055348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.055992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.056530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.056803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] PATH_INFO: `/v3/projects/f268077ba40b45a3a78b3f1e20b735c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.057938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f268077ba40b45a3a78b3f1e20b735c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.060394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.386625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 970/1934] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:28 2022] POST /identity/v3/users => generated 298 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:29.390783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.401211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c8144-8e3b-4e1d-8735-8dc7f9ef829e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.402711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f268077ba40b45a3a78b3f1e20b735c3', 'request_id': 'req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:29.409041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f268077ba40b45a3a78b3f1e20b735c3', 'request_id': 'req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:29.460296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.460914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.461195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.461668 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.462319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.463979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.488284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 971/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:29.491246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.502504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b405cd-9e7f-4e8a-a1b3-3cf73a16d489 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.510599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.511264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.511622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.512036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] PATH_INFO: `/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc/users/86e5301e69a14c04a4cddd2a0c8df487/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.526619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec288446eb3645a9b3a1e1c68efe96cc, user_id=86e5301e69a14c04a4cddd2a0c8df487, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.529411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.534207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f268077ba40b45a3a78b3f1e20b735c3', 'request_id': 'req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:29.545846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] The token cache is being invalidate because project f268077ba40b45a3a78b3f1e20b735c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:29.546138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:29.546805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a4896232-ce9c-4c08-8bb7-2bbfa02458ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:29.548364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 965/1936] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:28 2022] DELETE /identity/v3/projects/f268077ba40b45a3a78b3f1e20b735c3 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:29.553915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcacc7f-b95c-45be-9bc4-a7453e5443a8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.554196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcacc7f-b95c-45be-9bc4-a7453e5443a8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.554468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcacc7f-b95c-45be-9bc4-a7453e5443a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.573883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dbcacc7f-b95c-45be-9bc4-a7453e5443a8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:29.575121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dbcacc7f-b95c-45be-9bc4-a7453e5443a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:29.582852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 966/1937] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:29.590821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.591106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.591378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.610773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:29.611960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:29.619697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 967/1938] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:29.623583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.632873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a791e-1bcd-44b1-84fc-7b5b8c250d81 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.635241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 972/1939] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:29 2022] PUT /identity/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc/users/86e5301e69a14c04a4cddd2a0c8df487/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:29.637910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.639878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:29.695753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.696579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.696855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.697206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.697929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:29.698232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.699860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.710968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 968/1940] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:29.715758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.719346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd6a4-5c5d-4bb4-9bef-850e274facf3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.723997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.724608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.725002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.725249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.725537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5e4e-ac09-4c53-9fa6-3e1f8cdf5474 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.725907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.727609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.731283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.731986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.732265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.732544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.733188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.735181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.738302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 973/1941] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:29.742643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.752394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32811cc4-a41b-485b-ac13-f88d8c5032f2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.757270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.761364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.761364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.761364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] PATH_INFO: `/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc/users/86e5301e69a14c04a4cddd2a0c8df487/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.761364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec288446eb3645a9b3a1e1c68efe96cc, user_id=86e5301e69a14c04a4cddd2a0c8df487, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.761736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:29.763282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9179-451e-4692-b088-957f9322ca42 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.774220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 974/1942] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:29 2022] PUT /identity/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc/users/86e5301e69a14c04a4cddd2a0c8df487/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:29.785012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.790056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.790056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.813026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] MFA Rules not processed for user `86e5301e69a14c04a4cddd2a0c8df487`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:29.814227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:29.860902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 969/1943] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:29 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:29.866159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.885046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 975/1944] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:29.900904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:29.902303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:29.932451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656a30-3fa4-4544-b660-dcc0e1d5d1c8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:29.937577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:29.937994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:29.938313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:29.938629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:29.939256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:29.941169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:29.961497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd9d19-9646-49ce-ae55-c7b3abbe8419 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:30.009590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:30.010223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.010545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.010891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.012750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:30.049779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 970/1945] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:29 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:30.054218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:30.064698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9b089-4d75-4b1e-895e-4eadbf71f004 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:30.069479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:30.070126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.070625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.070741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.071374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:30.072999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:30.073323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:30.074857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:30.082978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 971/1946] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:30.086247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 976/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:30.087060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:30.097088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a42de-e93f-43ac-bb6e-3a0d54b48173 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:30.102090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:30.102930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.103222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.103499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.104172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:30.106312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4d372-8168-47f3-9075-2c444e7c14e4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:30.122638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 972/1948] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:30.123492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:30.134155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23000bf-8739-4a95-9eee-f5b1571e8e9d service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:30.141169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:30.141169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.141169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.141169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] PATH_INFO: `/v3/projects/11bb9cbfe91547c0bfb1d44ffa11340a/users/ca16ae4f0e534c4aaf3e67e2907b787c/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.157221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bb9cbfe91547c0bfb1d44ffa11340a, user_id=ca16ae4f0e534c4aaf3e67e2907b787c, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:30.159917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:30.242309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 977/1949] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:30 2022] PUT /identity/v3/projects/11bb9cbfe91547c0bfb1d44ffa11340a/users/ca16ae4f0e534c4aaf3e67e2907b787c/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:30.243050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.243050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.243050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.273964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] MFA Rules not processed for user `ca16ae4f0e534c4aaf3e67e2907b787c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:30.275367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:30.363881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 973/1950] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:30.400439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:30.402150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:30.480507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c165-ff58-4882-baa1-89c8edbbd11a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:30.484890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:30.485632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:30.485833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:30.486325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:30.495149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:30.496826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:30.513951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 978/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:30.808230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:31.260733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:31.912073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:32.260001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:32.664882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:33.877749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:33.929108 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:34.442086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:34.848136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:34.849644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:34.913698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:34.973864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915a934-b570-4e7b-bdde-9a4450681b9d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:34.980193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:34.980883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:34.981166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:34.981607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] PATH_INFO: `/v3/users/484d1b3c58834adcb10a32c410f9c986` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:34.982909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=484d1b3c58834adcb10a32c410f9c986)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:34.985773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:34.992933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa8ef-691c-45a9-8d43-ded9d5eb949f service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:35.003226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:35.004153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:35.004478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:35.004819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] PATH_INFO: `/v3/users/ca16ae4f0e534c4aaf3e67e2907b787c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:35.006669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca16ae4f0e534c4aaf3e67e2907b787c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:35.010014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:35.223334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484d1b3c58834adcb10a32c410f9c986'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.223471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca16ae4f0e534c4aaf3e67e2907b787c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.238002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:35.305868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484d1b3c58834adcb10a32c410f9c986'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.321225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484d1b3c58834adcb10a32c410f9c986'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.328037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484d1b3c58834adcb10a32c410f9c986'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.328757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-56cdb383-760e-42c5-9c02-c205ae7e884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484d1b3c58834adcb10a32c410f9c986'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.334855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 974/1952] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:34 2022] DELETE /identity/v3/users/484d1b3c58834adcb10a32c410f9c986 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:35.408836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca16ae4f0e534c4aaf3e67e2907b787c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.425117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca16ae4f0e534c4aaf3e67e2907b787c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.436812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca16ae4f0e534c4aaf3e67e2907b787c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.437538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca16ae4f0e534c4aaf3e67e2907b787c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.443683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 979/1953] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:34 2022] DELETE /identity/v3/users/ca16ae4f0e534c4aaf3e67e2907b787c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:35.448273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:35.448634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:35.448982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:35.468897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:35.470219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:35.532849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 975/1954] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:35.542840 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:35.547978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:35.558162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:35.620430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f26b-d698-447b-b1b4-ee5082624d98 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:35.624920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:35.625558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:35.625836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:35.626109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:35.636201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:35.637690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb800f-c969-48cb-998b-b6a1081946a8 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:35.647662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 980/1955] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:35.769693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:35.772253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:35.801400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97858-dcc1-4eb9-bdaf-59fc086be1dc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:35.804775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:35.805426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:35.805732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:35.805999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] PATH_INFO: `/v3/projects/8c2189fee4104db6a92e920bfe256b0e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:35.807278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2189fee4104db6a92e920bfe256b0e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:35.809235 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:35.927512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2189fee4104db6a92e920bfe256b0e', 'request_id': 'req-8c452000-fd03-40da-a935-aa2d2b690544'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:35.933933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2189fee4104db6a92e920bfe256b0e', 'request_id': 'req-8c452000-fd03-40da-a935-aa2d2b690544'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.020612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2189fee4104db6a92e920bfe256b0e', 'request_id': 'req-8c452000-fd03-40da-a935-aa2d2b690544'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.036791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] The token cache is being invalidate because project 8c2189fee4104db6a92e920bfe256b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:36.036791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.036791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c452000-fd03-40da-a935-aa2d2b690544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.037893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 976/1956] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:35 2022] DELETE /identity/v3/projects/8c2189fee4104db6a92e920bfe256b0e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:36.042733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.043602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.043884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.064571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:36.065864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.127739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 981/1957] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:36.137914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.138728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.138971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.145938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.151202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.166348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f7a95-3df0-43ab-9d46-ef214485e058 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.171775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.172371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.172652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.172920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] PATH_INFO: `/v3/projects/11bb9cbfe91547c0bfb1d44ffa11340a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.174222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bb9cbfe91547c0bfb1d44ffa11340a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.176764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.191674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:36.193852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.204565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 977/1958] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:36.208725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.218784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd06038-c331-4055-8c10-7406e07acdb8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.223504 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.224103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.224496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.224770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.225419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:36.225716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.227812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.245252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 978/1959] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:36.248884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.258861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f03a3-5b0a-466e-a642-930726de6e34 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.263967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.264561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.264838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.265107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.265752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.267648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.288251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bb9cbfe91547c0bfb1d44ffa11340a', 'request_id': 'req-5b544dca-d801-440f-8a43-1ecea641f4f1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.294455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bb9cbfe91547c0bfb1d44ffa11340a', 'request_id': 'req-5b544dca-d801-440f-8a43-1ecea641f4f1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.369588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:36.371896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bb9cbfe91547c0bfb1d44ffa11340a', 'request_id': 'req-5b544dca-d801-440f-8a43-1ecea641f4f1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.379865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 979/1960] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:36.379865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.379865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.383045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] The token cache is being invalidate because project 11bb9cbfe91547c0bfb1d44ffa11340a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:36.383333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.383985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.385804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 982/1961] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:36 2022] DELETE /identity/v3/projects/11bb9cbfe91547c0bfb1d44ffa11340a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:36.386348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.388186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.409841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:36.448244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52176f0-95e3-4721-84a4-ab70f08e8935 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.454565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b544dca-d801-440f-8a43-1ecea641f4f1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.454738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.454738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.454738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.454738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] PATH_INFO: `/v3/users/5ec3211e0e304d7791018193996f4ed8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.455868 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec3211e0e304d7791018193996f4ed8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.457772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.458892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.460157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.460626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.461297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.461990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.464364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6d928-eacf-4c42-842a-8f54df9a726c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.575231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 983/1962] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:36.576477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.576761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.577061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.596923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:36.598131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.605947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 984/1963] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:36.606773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.616733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b808-4df9-4a12-bee4-10e45e940a6f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.624208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.624834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.625115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.625390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.626047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.627677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885a2ef-068e-4656-a727-57c5211656ea admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.639111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 985/1964] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:36.639660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.639944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.640225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.658815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:36.660032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.671597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 986/1965] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:36.672438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.674823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec3211e0e304d7791018193996f4ed8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.685419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5596b1-8adf-4bda-b907-c7978a81b7b9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.690138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.690857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.691113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.691410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.692046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.693792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.710153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 987/1966] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:36.711052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.720714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc0ce3-346c-4338-aaa5-1300a411f186 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.725265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.725900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.726184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.726450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.727161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:36.727459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.729024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.741234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 988/1967] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:36.742019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.752418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0919-3862-46a9-bf02-81faf872d5c0 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.756556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:36.759021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.759751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.760136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.760479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] PATH_INFO: `/v3/projects/8042a8c3e31a415f91d0d5f227354554/users/6b69918cb9a7405e8904af0291efefb9/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.776541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8042a8c3e31a415f91d0d5f227354554, user_id=6b69918cb9a7405e8904af0291efefb9, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.779527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df1f4-9800-4d6c-9aee-f6015850c0e8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:36.791679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec3211e0e304d7791018193996f4ed8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.805124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:36.815328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec3211e0e304d7791018193996f4ed8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.822589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec3211e0e304d7791018193996f4ed8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.823505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec3211e0e304d7791018193996f4ed8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:36.830093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 980/1968] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:36 2022] DELETE /identity/v3/users/5ec3211e0e304d7791018193996f4ed8 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:36.831053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:36.832565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.865824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 989/1969] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:36 2022] PUT /identity/v3/projects/8042a8c3e31a415f91d0d5f227354554/users/6b69918cb9a7405e8904af0291efefb9/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:36.865824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47eac4-994a-432b-957f-a239c1cfcd81 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.865824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47eac4-994a-432b-957f-a239c1cfcd81 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.865824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47eac4-994a-432b-957f-a239c1cfcd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.891643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4e47eac4-994a-432b-957f-a239c1cfcd81 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:36.893170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4e47eac4-994a-432b-957f-a239c1cfcd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:36.917792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffdf20-6b46-4165-9c51-d5279bd62c11 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:36.957966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 990/1970] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:36.961748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.961748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.961748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.992279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:36.992929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:36.993364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:36.993641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:36.994417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:36.997106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.010567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:37.012771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.026925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 991/1971] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:37.026925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.031521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.037436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:37.101568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 981/1972] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:36 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:37.102509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.104824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.109782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e4d2c-7433-4996-840e-563edde79078 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.160442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.161063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.161402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.161659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.163484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058776f2-a5e7-4661-8352-3572f77c5431 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.167094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.167752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.168608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.168883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.175532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:37.224007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.225415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.232605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.234011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.235691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 992/1973] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:37.236575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.238228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.243834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 982/1974] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:37.251495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.252381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:37.262841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778f693-62bc-4817-8c9e-dcca09a3dd15 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.273706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:37.274986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.275733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.276064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.276361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.277843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.280988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.323268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af8d6-8cc8-4c51-9639-f30241bc9fec service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.330724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.331059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.331364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.331611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.333970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.401231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.403276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.408828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 983/1975] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:37 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:37.409826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.421451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae15798-c30c-43cf-a1ea-631aa4aa0acb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.421864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 993/1976] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:37.429461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.430061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.430344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.431248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.433454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.435452 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.446224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 984/1977] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:37.456866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.462306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f72cea-15a9-46a5-a9ff-ade8803606b9 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.468182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.468896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.469257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.469671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.470364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.472671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc0f8-c2ba-44e3-9286-d0095ab9316f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.490538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 994/1978] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:37.495233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.507442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:37.508114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bc0db-c57e-480d-a23c-625cd07895fb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.514773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.515518 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.515833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.516124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] PATH_INFO: `/v3/projects/7162a397dc394625919493e14eabe780/users/9b53d11fc61b44c48054e62b7103ab7f/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.534652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7162a397dc394625919493e14eabe780, user_id=9b53d11fc61b44c48054e62b7103ab7f, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.540436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.635814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 985/1979] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:37 2022] PUT /identity/v3/projects/7162a397dc394625919493e14eabe780/users/9b53d11fc61b44c48054e62b7103ab7f/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:37.641439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.641751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.642028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.661382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:37.662729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.729644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 995/1980] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:37.739382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.799689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d022b-2f33-47c2-9f9e-d82ad8b508a3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.803652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.804260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.804539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.804809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.817321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.817321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.828193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 986/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:37.834907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:37.836503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:37.852146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731282a-5fab-4609-bd45-fbfe1939d5ef None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:37.856359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:37.857252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:37.857871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:37.857871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] PATH_INFO: `/v3/projects/ee639d12d47348b48d2f3e1b090bdac7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:37.859197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee639d12d47348b48d2f3e1b090bdac7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:37.861350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:37.989033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee639d12d47348b48d2f3e1b090bdac7', 'request_id': 'req-47d1f703-0924-4717-8458-27cc8e8f6cce'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.000167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee639d12d47348b48d2f3e1b090bdac7', 'request_id': 'req-47d1f703-0924-4717-8458-27cc8e8f6cce'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.077044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:38.098558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee639d12d47348b48d2f3e1b090bdac7', 'request_id': 'req-47d1f703-0924-4717-8458-27cc8e8f6cce'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.117215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] The token cache is being invalidate because project ee639d12d47348b48d2f3e1b090bdac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:38.117777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.130549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.134239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 996/1982] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:37 2022] DELETE /identity/v3/projects/ee639d12d47348b48d2f3e1b090bdac7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:38.137440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:38.148997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a3dec-9aa7-4739-9f01-00445b0edb8c service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:38.212414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:38.213096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:38.213378 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:38.213676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] PATH_INFO: `/v3/users/91797aa7bc9542d6979e28642aeff51a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:38.214897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91797aa7bc9542d6979e28642aeff51a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:38.216817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:38.272486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:38.401671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91797aa7bc9542d6979e28642aeff51a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.477752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91797aa7bc9542d6979e28642aeff51a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.492312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91797aa7bc9542d6979e28642aeff51a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.500128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91797aa7bc9542d6979e28642aeff51a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.500786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1e0b3ed2-cf4f-415b-ade6-50399fe52b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91797aa7bc9542d6979e28642aeff51a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:38.506662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 987/1983] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:38 2022] DELETE /identity/v3/users/91797aa7bc9542d6979e28642aeff51a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:38.977760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:38.979489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:38.996585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f703-0924-4717-8458-27cc8e8f6cce admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:39.075230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:39.075956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.076336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.076684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] PATH_INFO: `/v3/projects/04169d45387b4fdd9cfe567e504a4a96` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.078097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=04169d45387b4fdd9cfe567e504a4a96)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:39.080412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:39.236437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04169d45387b4fdd9cfe567e504a4a96', 'request_id': 'req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:39.248303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04169d45387b4fdd9cfe567e504a4a96', 'request_id': 'req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:39.347084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04169d45387b4fdd9cfe567e504a4a96', 'request_id': 'req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:39.359419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] The token cache is being invalidate because project 04169d45387b4fdd9cfe567e504a4a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:39.359703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:39.363794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e21710d5-293e-4e67-8c0d-ce17fcf25dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:39.365405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 997/1984] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:38 2022] DELETE /identity/v3/projects/04169d45387b4fdd9cfe567e504a4a96 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:39.371600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.372119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.372325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.400698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:39.403316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:39.478691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 988/1985] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:39.481045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.481359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.481637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.517047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:39.517047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:39.527949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 998/1986] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:39.531958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:39.551587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852ab0-5110-4526-88d7-a68c5b23bec1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:39.571991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:39.576299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.576600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.576879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.577605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:39.577914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:39.579642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:39.592619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 989/1987] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:39.597059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:39.606626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480f13-e7cb-48a1-88b5-4b754804a719 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:39.611529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:39.612169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.612669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.612940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.613581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:39.615683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:39.695124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:39.764286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 999/1988] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:39.768422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:39.779831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34880c-8227-4603-b9cc-27fd98a7fcf6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:39.847799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:39.871795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:39.872566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:39.873012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:39.873299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:39.874436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:39.877085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:39.991393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 990/1989] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:39 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:39.998544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.021483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab48f2-5bc8-43da-89d0-6676bb617ea6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.026591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.027320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.027674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.028012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.028845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.030808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:40.045676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1000/1990] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:40.048880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.062900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223ace-6a57-41b9-822e-43f176256e73 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.075217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.075859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.076143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.076419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.077074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.078707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620533a7-7132-43ea-b2dd-69f038490e92 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:40.092539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 991/1991] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:40.097348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.109577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1c3e-f522-4f3a-8155-81a467d3db56 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.114238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.114934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.115208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.115528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] PATH_INFO: `/v3/projects/04c7fce409d84d51a808ddb585fdbb84/users/c715bdf95baa46c8a874a30c3563a0e4/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.135747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c7fce409d84d51a808ddb585fdbb84, user_id=c715bdf95baa46c8a874a30c3563a0e4, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.140199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:40.268657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1001/1992] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:40 2022] PUT /identity/v3/projects/04c7fce409d84d51a808ddb585fdbb84/users/c715bdf95baa46c8a874a30c3563a0e4/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:40.281537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.282720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.283209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.323369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] MFA Rules not processed for user `c715bdf95baa46c8a874a30c3563a0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:40.324749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:40.431713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 992/1993] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:40.437779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.529439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be61-f578-41b8-9e7f-2511e35311e9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.541595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.544081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.544431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.545233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.547056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.549425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:40.713597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1002/1994] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:40 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:40.715733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.727075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b66024-3182-4744-aaf6-e6545ecc208c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.803674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.806704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.807437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.808954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.809907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.815734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:40.959920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 993/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:40 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:40.960855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:40.981189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4836ce-fa28-421a-be09-2cf7f6548907 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:40.987163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:40.987793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:40.988069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:40.988346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:40.989002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:40.990616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:41.019786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1003/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:41.023156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:41.036449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029e94f-804a-4877-bf15-8ceac2b3cc21 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:41.059116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:41.059814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.060099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.061141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] PATH_INFO: `/v3/projects/ce9875473c3c452d8a28887b660c16ed/users/6cefcebfe1c24ac6977f92e34effbe17/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.094853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9875473c3c452d8a28887b660c16ed, user_id=6cefcebfe1c24ac6977f92e34effbe17, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:41.102701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:41.228495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 994/1997] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:41 2022] PUT /identity/v3/projects/ce9875473c3c452d8a28887b660c16ed/users/6cefcebfe1c24ac6977f92e34effbe17/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:41.232677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:41.245937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9bdf8-cf9a-4795-b6af-a8ba125eb1ff admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:41.387302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:41.387995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.388207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.388478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.390699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:41.392919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9a1f-4fb9-4402-b4c6-cbca2398b240 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:41.419703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1004/1998] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:41.423649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:41.438546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01087-7064-4500-bd6f-9742d375e989 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:41.450896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:41.451833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.452267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.452732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] PATH_INFO: `/v3/projects/ce9875473c3c452d8a28887b660c16ed/users/6cefcebfe1c24ac6977f92e34effbe17/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.455702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9875473c3c452d8a28887b660c16ed, user_id=6cefcebfe1c24ac6977f92e34effbe17, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:41.459334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:41.477335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 995/1999] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:41 2022] PUT /identity/v3/projects/ce9875473c3c452d8a28887b660c16ed/users/6cefcebfe1c24ac6977f92e34effbe17/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:41.488311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.488605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.489119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.557372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] MFA Rules not processed for user `6cefcebfe1c24ac6977f92e34effbe17`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:41.564410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:41.632285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:41.668477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1005/2000] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:41.680240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:41.681967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:41.753255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e3d53-cede-4858-9440-bec6bc53f154 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:41.756970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:41.757787 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.758126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.758406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.767644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:41.769075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d4978-d5e6-44d0-aa0a-27b3ad10a530 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:41.779651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 996/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:41.781683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:41.871360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:41.966196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12628a-74e6-4fc6-8a73-ad3166a96218 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:41.971790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:41.977762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:41.978103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:41.978384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] PATH_INFO: `/v3/users/c715bdf95baa46c8a874a30c3563a0e4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:41.980412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c715bdf95baa46c8a874a30c3563a0e4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:41.981903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:42.241914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c715bdf95baa46c8a874a30c3563a0e4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:42.332607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c715bdf95baa46c8a874a30c3563a0e4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:42.365053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c715bdf95baa46c8a874a30c3563a0e4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:42.376398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c715bdf95baa46c8a874a30c3563a0e4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:42.377459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c715bdf95baa46c8a874a30c3563a0e4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:42.410697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1006/2002] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:41 2022] DELETE /identity/v3/users/c715bdf95baa46c8a874a30c3563a0e4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:42.415373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:42.415815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:42.416196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:42.441248 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:42.458481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:42.584588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 997/2003] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:42.597320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:42.600449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:42.680911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641a81-0c7e-4fbc-aac1-f80453094c8b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:42.687181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:42.688213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:42.688643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:42.689233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:42.705033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:42.706876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c40755-f3ba-43c6-8f5b-fcf82b3e6373 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:42.723304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1007/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:42.945967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:43.483871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:43.689066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:43.833292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:43.834891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:43.858162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5699-40a0-42d7-a249-c727fe7d0a32 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:43.867316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:43.867991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:43.873576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:43.873924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] PATH_INFO: `/v3/users/d5296715f28d478188813dbf0948d1b3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:43.875490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5296715f28d478188813dbf0948d1b3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:43.877481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:44.102869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5296715f28d478188813dbf0948d1b3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.191525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5296715f28d478188813dbf0948d1b3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.212451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5296715f28d478188813dbf0948d1b3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.223904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5296715f28d478188813dbf0948d1b3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.228813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5296715f28d478188813dbf0948d1b3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.251778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 998/2005] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:43 2022] DELETE /identity/v3/users/d5296715f28d478188813dbf0948d1b3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:44.256814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:44.257447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:44.258011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:44.274833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:44.276595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:44.297059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:44.298595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:44.409735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff2b7f-eb0a-4265-87a2-9596e5312993 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:44.416322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:44.417240 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:44.417672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:44.418662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] PATH_INFO: `/v3/projects/04c7fce409d84d51a808ddb585fdbb84` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:44.420490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c7fce409d84d51a808ddb585fdbb84)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:44.421232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1008/2006] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:44.422898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:44.442729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:44.444558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:44.598018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecceb93-850e-4e91-87f4-0874cfa24078 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:44.602081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:44.602742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:44.603061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:44.603335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:44.621442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:44.625255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:44.645011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c7fce409d84d51a808ddb585fdbb84', 'request_id': 'req-93a5fc57-b00b-4924-8014-e3b7c93a9db9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.653311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1009/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:44.660380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c7fce409d84d51a808ddb585fdbb84', 'request_id': 'req-93a5fc57-b00b-4924-8014-e3b7c93a9db9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.705471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:44.762141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c7fce409d84d51a808ddb585fdbb84', 'request_id': 'req-93a5fc57-b00b-4924-8014-e3b7c93a9db9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.785065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] The token cache is being invalidate because project 04c7fce409d84d51a808ddb585fdbb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:44.786366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.787967 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:44.792632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 999/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:44 2022] DELETE /identity/v3/projects/04c7fce409d84d51a808ddb585fdbb84 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:44.797037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:44.810961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00524d-ba8a-4072-9186-86b823bd9ec7 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:44.910035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:44.911283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:44.912915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:44.915994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] PATH_INFO: `/v3/users/6cefcebfe1c24ac6977f92e34effbe17` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:44.918679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cefcebfe1c24ac6977f92e34effbe17)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:44.928467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:45.176233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cefcebfe1c24ac6977f92e34effbe17'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:45.248915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cefcebfe1c24ac6977f92e34effbe17'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:45.274830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cefcebfe1c24ac6977f92e34effbe17'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:45.284538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cefcebfe1c24ac6977f92e34effbe17'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:45.286039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ee0eb8ce-685d-4744-94ce-c0d52fd20995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cefcebfe1c24ac6977f92e34effbe17'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:45.295301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1010/2009] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:44 2022] DELETE /identity/v3/users/6cefcebfe1c24ac6977f92e34effbe17 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:45.656768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:45.656768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:45.710476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5fc57-b00b-4924-8014-e3b7c93a9db9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:45.820246 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:45.820394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:45.821548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:45.823800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:45.830295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] PATH_INFO: `/v3/projects/61751f6414004fd8a2c7c84b55f8ff04` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:45.830295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61751f6414004fd8a2c7c84b55f8ff04)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:45.832433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:45.968691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:45.969216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:45.969713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:46.011384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] MFA Rules not processed for user `6b69918cb9a7405e8904af0291efefb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:46.012848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.034289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61751f6414004fd8a2c7c84b55f8ff04', 'request_id': 'req-963363db-9494-40a5-a22e-a0bd6230b384'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.050426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61751f6414004fd8a2c7c84b55f8ff04', 'request_id': 'req-963363db-9494-40a5-a22e-a0bd6230b384'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.158460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61751f6414004fd8a2c7c84b55f8ff04', 'request_id': 'req-963363db-9494-40a5-a22e-a0bd6230b384'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.173672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] The token cache is being invalidate because project 61751f6414004fd8a2c7c84b55f8ff04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:46.176243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.177965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.184955 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1000/2010] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:45 2022] DELETE /identity/v3/projects/61751f6414004fd8a2c7c84b55f8ff04 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:46.190782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:46.193167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.220417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1011/2011] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:46.238310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:46.240110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.381403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963363db-9494-40a5-a22e-a0bd6230b384 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:46.387587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:46.388388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:46.388742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:46.389078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] PATH_INFO: `/v3/users/86e5301e69a14c04a4cddd2a0c8df487` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:46.390333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e5301e69a14c04a4cddd2a0c8df487)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:46.392387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:46.399267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1cee-e230-41f2-9058-cdf17af586bf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:46.420109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:46.420109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:46.420109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:46.420109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:46.420655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.438774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:46.443003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab3752-8d70-456b-bb84-de87d863b235 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:46.485687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1012/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:46.540405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:46.540904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:46.541333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:46.593490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] MFA Rules not processed for user `9b53d11fc61b44c48054e62b7103ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:46.594893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.677807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1013/2013] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:46.677807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:46.683083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.705362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e5301e69a14c04a4cddd2a0c8df487'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.709423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2002d-14ea-40be-a778-7d90abdfd97a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:46.715365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:46.716027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:46.716326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:46.716598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] PATH_INFO: `/v3/projects/ce9875473c3c452d8a28887b660c16ed` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:46.717761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9875473c3c452d8a28887b660c16ed)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:46.719757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:46.750622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:46.779280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e5301e69a14c04a4cddd2a0c8df487'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.795588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e5301e69a14c04a4cddd2a0c8df487'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.813510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e5301e69a14c04a4cddd2a0c8df487'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.814466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e5301e69a14c04a4cddd2a0c8df487'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.822698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1001/2014] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:46 2022] DELETE /identity/v3/users/86e5301e69a14c04a4cddd2a0c8df487 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:46.824604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:46.827767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:46.902845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9875473c3c452d8a28887b660c16ed', 'request_id': 'req-9c04ee39-f05c-4393-8c56-9340d517ea1b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:46.915464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa03d67-a2f4-41ca-a7b4-763f52a678bf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:46.915617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9875473c3c452d8a28887b660c16ed', 'request_id': 'req-9c04ee39-f05c-4393-8c56-9340d517ea1b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:47.014719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9875473c3c452d8a28887b660c16ed', 'request_id': 'req-9c04ee39-f05c-4393-8c56-9340d517ea1b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:47.027496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.028677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.028970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.029253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.030114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.032559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.037501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] The token cache is being invalidate because project ce9875473c3c452d8a28887b660c16ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:47.037981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:47.038842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c04ee39-f05c-4393-8c56-9340d517ea1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:47.041011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1014/2015] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:46 2022] DELETE /identity/v3/projects/ce9875473c3c452d8a28887b660c16ed => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:47.046748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdf550-a385-4a14-9ed7-91e6fc5a4e4d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.047293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdf550-a385-4a14-9ed7-91e6fc5a4e4d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.047745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdf550-a385-4a14-9ed7-91e6fc5a4e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.086365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f1fdf550-a385-4a14-9ed7-91e6fc5a4e4d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:47.088435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1fdf550-a385-4a14-9ed7-91e6fc5a4e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:47.097606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1015/2016] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:47.107821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.108161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.108447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.146303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1002/2017] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:46 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:47.149568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:47.150947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:47.151189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.159736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:47.298413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1016/2018] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:47.303032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.325485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184a49-f168-4a59-b731-f348cd79557b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.330987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.331612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.331966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.332156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.333005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.334998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.346047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a2d62-1308-4770-8fc9-6875e9ed7a8e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.356799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.356799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.356799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.356799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.357100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:47.357100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.358357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.372539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1017/2019] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:47.379501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.392343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7a39-1347-4e23-8da8-50def75d1d23 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.398019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.398748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.399096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.399433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.400438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.403256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.478863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1003/2020] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:47 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:47.486575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.518055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf7ad-732d-46c1-9dd8-bb3a244e9c5e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.529834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1018/2021] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:47 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:47.531254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.537863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:47.669526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.671513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.677030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:47.677158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.677158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.677158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.678425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.695333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1004/2022] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:47.696554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.712537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e1ce3-8f64-4790-a93c-9a87b7b1f8bb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.721328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da607-834e-40dc-92c4-3fb8e580cda3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.749622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.755241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.757606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.758500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.759308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.760689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.762224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.762938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.763288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] PATH_INFO: `/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.765417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.767235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec288446eb3645a9b3a1e1c68efe96cc)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.771131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.867284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1005/2023] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:47 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:47.876097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.879924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2d992-6884-45c6-af4d-bdfae77fd439 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:47.884984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:47.885649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:47.885939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:47.886218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] PATH_INFO: `/v3/projects/672f26db04aa423d80d98f2b67cc03e2/users/552485af3db547d59b7238468d549303/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:47.904984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=672f26db04aa423d80d98f2b67cc03e2, user_id=552485af3db547d59b7238468d549303, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:47.907733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:47.992726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1006/2024] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:47 2022] PUT /identity/v3/projects/672f26db04aa423d80d98f2b67cc03e2/users/552485af3db547d59b7238468d549303/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:47.992726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:47.995166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec288446eb3645a9b3a1e1c68efe96cc', 'request_id': 'req-ff618fe1-c852-4706-bd3f-92984469d909'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:48.003420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec288446eb3645a9b3a1e1c68efe96cc', 'request_id': 'req-ff618fe1-c852-4706-bd3f-92984469d909'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:48.071503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec288446eb3645a9b3a1e1c68efe96cc', 'request_id': 'req-ff618fe1-c852-4706-bd3f-92984469d909'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:48.077397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae26ce-af18-4e50-9dba-846e36d105aa admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.082511 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.083222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.083574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.083985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.084525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] The token cache is being invalidate because project ec288446eb3645a9b3a1e1c68efe96cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:48.084815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:48.084981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.085472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:48.086683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a42c1b-43d9-498d-91bf-2cb1c3185181 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.087195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1019/2025] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:47 2022] DELETE /identity/v3/projects/ec288446eb3645a9b3a1e1c68efe96cc => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:48.090748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.090748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:48.099790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1007/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:48.101136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.101426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.101708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.112876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:48.131601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:48.132846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:48.145183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1008/2027] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:48.146083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.147871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:48.164057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fcd83-75c4-4f09-a71b-a9a2a63eedbc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.178477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.178997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.179222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.179519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.180434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.182316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ddef9-dae8-4abd-8842-11354ab5a910 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.196994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1009/2028] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:48.198316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322767a-a359-49df-8a78-918277c9b48e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.198624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322767a-a359-49df-8a78-918277c9b48e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.199437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322767a-a359-49df-8a78-918277c9b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.204421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618fe1-c852-4706-bd3f-92984469d909 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.210552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.211269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.211565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.211837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.212500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.215404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.225423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c322767a-a359-49df-8a78-918277c9b48e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:48.227451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c322767a-a359-49df-8a78-918277c9b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:48.232690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:48.233981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.240706 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1010/2030] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:48.241605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322767a-a359-49df-8a78-918277c9b48e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.248270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e51a4-6408-45a0-986f-4513f5acaf36 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.251859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322767a-a359-49df-8a78-918277c9b48e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.253491 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.254263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.254671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.255093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] PATH_INFO: `/v3/projects/c30e4696336849f784f1a665b49cb780/users/ea93ad9f5bc848dcab6b1eefdd925670/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.257534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.258204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.258489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.258803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] PATH_INFO: `/v3/projects/672f26db04aa423d80d98f2b67cc03e2/users/552485af3db547d59b7238468d549303/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.260916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672f26db04aa423d80d98f2b67cc03e2, user_id=552485af3db547d59b7238468d549303, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.263849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.274945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30e4696336849f784f1a665b49cb780, user_id=ea93ad9f5bc848dcab6b1eefdd925670, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.278158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593f5f-e080-48b1-9deb-c4eeaeda04de admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.280179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1011/2031] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:48 2022] PUT /identity/v3/projects/672f26db04aa423d80d98f2b67cc03e2/users/552485af3db547d59b7238468d549303/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:48.281157 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.366581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1021/2032] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:48 2022] PUT /identity/v3/projects/c30e4696336849f784f1a665b49cb780/users/ea93ad9f5bc848dcab6b1eefdd925670/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:48.369975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.370259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.370545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.383225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b678c-f637-4f2a-a1d3-1e9046244b45 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.401873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] MFA Rules not processed for user `ea93ad9f5bc848dcab6b1eefdd925670`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:48.404123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:48.488877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.489871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.493531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.493531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.493531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:48.493531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.494112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.510922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1012/2033] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:48.516223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.532928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66241-285c-421e-baf8-83ec487aedba admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.545645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.546276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.546576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.546854 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.547481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.553624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.571253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1022/2034] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:48.578785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.609709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5054f-c7c8-4287-a508-d1c9fcc0b42a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.619755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:48.621862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.623692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.624068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.629711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.629711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.629711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.683681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1013/2035] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:48.688388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.775972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1023/2036] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:48.781778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:48.821576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d3bd3-8aec-49fd-bd24-b455a84242a4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.936116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.937896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.938839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.939881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fbd6d-b954-4a4e-b4a5-ee770dff8a38 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:48.940284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.941196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.945983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:48.963296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:48.963939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:48.964221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:48.965591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:48.966260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:48.968242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.099337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1014/2037] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/users => generated 288 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:49.103824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.115741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84820a44-7ba2-45e0-a549-dac21eef23b5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.122933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:49.124046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.124916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.125293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.125703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.126479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.128415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.130672 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1024/2038] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:48 2022] POST /identity/v3/users => generated 296 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:49.134600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.147214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1015/2039] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:49.148892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.155478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff2fd7-0c06-4a78-8e96-06670c330df6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.162372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.163238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.163645 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.164051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.164857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.166857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.181460 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1025/2040] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:49.185495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07e60-2c61-4a21-8a84-328002375e35 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.186538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.192905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.193697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.194111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.194633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.199646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.199646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.214727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1016/2041] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:49.216010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.220783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ff18-bbe8-4431-b3f4-1662ae5edc7e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.227041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34126-85b4-4cbe-bd71-51710fc8eef7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.233054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.233230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.233976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.234369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.234867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.235310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] PATH_INFO: `/v3/projects/704443331dba424b9430b0483bd87cd7/users/a23caa86442245de88e416069447906a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.235887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.236176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] PATH_INFO: `/v3/projects/e7823e1f891a40ae94138025eeaa9a1e/users/693b3c4b38e746e88d75ea66d4d57182/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.273451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7823e1f891a40ae94138025eeaa9a1e, user_id=693b3c4b38e746e88d75ea66d4d57182, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.276455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704443331dba424b9430b0483bd87cd7, user_id=a23caa86442245de88e416069447906a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.278213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.279751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9978e7-029f-427b-b472-c7192991ef87 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.408138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1017/2042] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:49 2022] PUT /identity/v3/projects/704443331dba424b9430b0483bd87cd7/users/a23caa86442245de88e416069447906a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:49.415943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1026/2043] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:49 2022] PUT /identity/v3/projects/e7823e1f891a40ae94138025eeaa9a1e/users/693b3c4b38e746e88d75ea66d4d57182/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:49.416191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.416517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.416769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.419673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.479352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] MFA Rules not processed for user `a23caa86442245de88e416069447906a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:49.481702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:49.518457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912c399-1028-4add-8f59-59af1df14ac2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.597611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.598817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.599244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.599882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.600794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.602962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.616321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1018/2044] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:49.620269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.621794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:49.622874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.638146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5f14-574a-43b2-89b7-8d6ba352bc0f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.638332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c88f1-704f-4253-ae26-5dc96615d595 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.643419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.643849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.644476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.644756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.645041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.645616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.645725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.646268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.646792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] PATH_INFO: `/v3/projects/e7823e1f891a40ae94138025eeaa9a1e/users/693b3c4b38e746e88d75ea66d4d57182/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.648349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.649632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7823e1f891a40ae94138025eeaa9a1e, user_id=693b3c4b38e746e88d75ea66d4d57182, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.653938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040e3e-6190-42d6-888b-be57327b6642 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.680669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1028/2046] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:49 2022] PUT /identity/v3/projects/e7823e1f891a40ae94138025eeaa9a1e/users/693b3c4b38e746e88d75ea66d4d57182/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:49.682588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.683147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.684591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.718393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] MFA Rules not processed for user `693b3c4b38e746e88d75ea66d4d57182`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:49.719829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:49.802997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1019/2047] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:49 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:49.804403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.858106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1029/2048] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:49.876525 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:49.877951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:49.917102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfac726-764b-4407-beeb-352129c58bf4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:49.925129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:49.926152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:49.926559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:49.927133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:49.928809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:49.932312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:49.994997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9d2b4-6574-4750-874c-057e54b04606 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.045982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1020/2049] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:49 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:50.049840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:50.070632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b096c-0881-4c37-9fc9-384f3be4081f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.078786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.079672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.080112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.083082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.083082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:50.083358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:50.086561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.087768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.088055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.088447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.096615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1021/2050] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:03:50.100353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:50.115668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cffb4-3525-40dd-af52-03b617ae4405 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.122218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.123199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.124037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.124515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] PATH_INFO: `/v3/projects/5591d656e54a4a278dfa322a6528dbb5/users/54963804d20a4bb8ac6e3885d375735b/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.149564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5591d656e54a4a278dfa322a6528dbb5, user_id=54963804d20a4bb8ac6e3885d375735b, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:50.154842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6945a-5010-48ab-927b-e4ee1ffc0cef admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:50.172352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:50.179141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:50.195147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1030/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:50.257110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1022/2052] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:50 2022] PUT /identity/v3/projects/5591d656e54a4a278dfa322a6528dbb5/users/54963804d20a4bb8ac6e3885d375735b/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:50.265110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:50.265660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5223b-4684-4705-b330-87b835963bfb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.265939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5223b-4684-4705-b330-87b835963bfb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.266216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5223b-4684-4705-b330-87b835963bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.279250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4683e6-0c5d-4c7e-969a-375e3581bf73 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.300247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cfd5223b-4684-4705-b330-87b835963bfb None None] MFA Rules not processed for user `6b69918cb9a7405e8904af0291efefb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:50.307335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfd5223b-4684-4705-b330-87b835963bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:50.389766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.390712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.390992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.391261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.392631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:50.393580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:50.406288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1031/2053] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:50.410303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:50.463959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1023/2054] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:50.470945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f1311-a85c-4f6d-9eae-da64a6e0eb83 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.483144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.484107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.484593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.485367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] PATH_INFO: `/v3/projects/5591d656e54a4a278dfa322a6528dbb5/users/54963804d20a4bb8ac6e3885d375735b/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.502268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5591d656e54a4a278dfa322a6528dbb5, user_id=54963804d20a4bb8ac6e3885d375735b, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:50.503848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:50.524522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1032/2055] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:50 2022] PUT /identity/v3/projects/5591d656e54a4a278dfa322a6528dbb5/users/54963804d20a4bb8ac6e3885d375735b/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:50.543674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423225ee-33a4-45c0-8377-803852502343 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.543674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423225ee-33a4-45c0-8377-803852502343 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.543921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423225ee-33a4-45c0-8377-803852502343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:50.626618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-423225ee-33a4-45c0-8377-803852502343 None None] MFA Rules not processed for user `54963804d20a4bb8ac6e3885d375735b`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:50.628112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-423225ee-33a4-45c0-8377-803852502343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:50.655143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:50.813071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1024/2056] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:50.826610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:50.973523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db554ed-3e1a-40fa-ad96-0debecbc08cc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:50.976405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:50.977036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:50.977311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:50.977594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:51.127866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:51.129504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:51.148229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1033/2057] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:51.181098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:51.649165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423225ee-33a4-45c0-8377-803852502343 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:51.749046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423225ee-33a4-45c0-8377-803852502343 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:51.757121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '693b3c4b38e746e88d75ea66d4d57182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7823e1f891a40ae94138025eeaa9a1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:51.759765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:51.759765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:51.759765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:51.759765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:51.759765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:51.760989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:51.780408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1025/2058] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:51.781158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:51.810296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0746-f788-49d5-897c-e5d8691cc435 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:51.833663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '693b3c4b38e746e88d75ea66d4d57182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7823e1f891a40ae94138025eeaa9a1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:51.835306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:51.839377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:51.841407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:51.842288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:51.846490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:51.989761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1034/2059] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:51 2022] POST /identity/v3/projects => generated 354 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:51.993060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:52.007785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955a970-2628-41a3-8c5e-363166a0a2f8 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:52.125512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '693b3c4b38e746e88d75ea66d4d57182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7823e1f891a40ae94138025eeaa9a1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:52.127668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:52.132466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:52.132466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:52.132466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:52.132466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:52.132466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:52.147293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1026/2060] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:52.215992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:52.226774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663bbf2-b0a8-404d-a1db-31e4c21ad330 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:52.242124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '693b3c4b38e746e88d75ea66d4d57182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7823e1f891a40ae94138025eeaa9a1e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:52.243907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:52.243907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:52.244341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] PATH_INFO: `/v3/projects/79fa9a8b1ed6460481b32273cf8b8347` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:52.246285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79fa9a8b1ed6460481b32273cf8b8347)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:52.265699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:52.473757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79fa9a8b1ed6460481b32273cf8b8347', 'request_id': 'req-1feda463-0f5e-4176-87a4-84c572781935'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:52.487340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79fa9a8b1ed6460481b32273cf8b8347', 'request_id': 'req-1feda463-0f5e-4176-87a4-84c572781935'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:52.535765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:52.563053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79fa9a8b1ed6460481b32273cf8b8347', 'request_id': 'req-1feda463-0f5e-4176-87a4-84c572781935'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:52.580922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] The token cache is being invalidate because project 79fa9a8b1ed6460481b32273cf8b8347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:52.581682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:52.583168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1feda463-0f5e-4176-87a4-84c572781935 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:52.585297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1035/2061] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:52 2022] DELETE /identity/v3/projects/79fa9a8b1ed6460481b32273cf8b8347 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:53.431208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:53.889301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:53.891695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:54.009716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103f71c-b8e6-48b4-a30f-f3111ca2a3f7 tempest-VolumeQuotaClassesTest-738604415 tempest-VolumeQuotaClassesTest-738604415-project-admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:54.163112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:54.163948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:54.179031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:54.179562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] PATH_INFO: `/v3/users/ea93ad9f5bc848dcab6b1eefdd925670` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:54.181877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea93ad9f5bc848dcab6b1eefdd925670)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:54.184144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:54.465667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea93ad9f5bc848dcab6b1eefdd925670'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:54.568020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea93ad9f5bc848dcab6b1eefdd925670'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:54.582267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea93ad9f5bc848dcab6b1eefdd925670'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:54.591399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea93ad9f5bc848dcab6b1eefdd925670'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:54.593262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea93ad9f5bc848dcab6b1eefdd925670'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:54.601015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1027/2062] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:53 2022] DELETE /identity/v3/users/ea93ad9f5bc848dcab6b1eefdd925670 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:54.607142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:54.607626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:54.608211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:54.632384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:54.634041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:54.713258 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1036/2063] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:54.723333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:54.724857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:54.817071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a868ba-b50a-4f9e-a3eb-2274b5406a9a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:54.825939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:54.826847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:54.827272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:54.827691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:54.839019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:54.840659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d98e-ff0e-486e-b14d-e4a06b686990 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:54.864016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1028/2064] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:03:55.024279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:55.025705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:55.041413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc17ff-b399-40fd-8650-e8457229fc07 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:55.046998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:55.048044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:55.048554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:55.049021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] PATH_INFO: `/v3/users/a23caa86442245de88e416069447906a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:55.052064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23caa86442245de88e416069447906a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:55.054496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:55.235606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23caa86442245de88e416069447906a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.259373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:55.295647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23caa86442245de88e416069447906a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.342231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23caa86442245de88e416069447906a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.354295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23caa86442245de88e416069447906a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.354892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23caa86442245de88e416069447906a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.368136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1037/2065] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:55 2022] DELETE /identity/v3/users/a23caa86442245de88e416069447906a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:55.372382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:55.372950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:55.374077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:55.423778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:55.425189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:55.485866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:55.490856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:55.558565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1029/2066] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:55.571193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:55.575976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:55.670091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52e121-3f5d-4e14-9f95-2724143987cf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:55.675758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:55.677515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:55.678100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:55.694105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:55.701021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6272-7552-4a2d-bd1f-92475af1d1ea admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:55.720117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:55.721085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:55.722099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:55.722554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] PATH_INFO: `/v3/projects/c30e4696336849f784f1a665b49cb780` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:55.723198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:55.724597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30e4696336849f784f1a665b49cb780)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:55.726089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:55.726934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:55.761988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1030/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:55.932119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30e4696336849f784f1a665b49cb780', 'request_id': 'req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:55.945831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30e4696336849f784f1a665b49cb780', 'request_id': 'req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.082195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:56.082465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30e4696336849f784f1a665b49cb780', 'request_id': 'req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.102191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] The token cache is being invalidate because project c30e4696336849f784f1a665b49cb780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:56.102978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.105239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d53980bd-7216-4a35-93fb-dbc10b7ab2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.112869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:56.119785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1038/2068] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:55 2022] DELETE /identity/v3/projects/c30e4696336849f784f1a665b49cb780 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:56.130552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78928c6b-5cb4-4443-81ca-eb7bb2d4b337 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:56.245139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:56.246723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:56.247095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:56.247428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] PATH_INFO: `/v3/users/693b3c4b38e746e88d75ea66d4d57182` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:56.249166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=693b3c4b38e746e88d75ea66d4d57182)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:56.251893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:56.344050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:56.344402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:56.344678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:56.394724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] MFA Rules not processed for user `552485af3db547d59b7238468d549303`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:56.397248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:56.486161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693b3c4b38e746e88d75ea66d4d57182'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.501574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1039/2069] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:56.516815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:56.518545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:56.574396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693b3c4b38e746e88d75ea66d4d57182'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.601158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693b3c4b38e746e88d75ea66d4d57182'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.616625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693b3c4b38e746e88d75ea66d4d57182'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.625243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693b3c4b38e746e88d75ea66d4d57182'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.634829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1031/2070] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:56 2022] DELETE /identity/v3/users/693b3c4b38e746e88d75ea66d4d57182 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:03:56.638925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:56.641144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:56.676594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32890285-875b-4b72-a13a-310e43cb9440 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:56.766952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:56.768075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:56.769854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:56.771128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:56.775120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:56.779733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5597a-5aaa-4ef5-a56f-382d35195d6e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:56.805260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:56.806101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:56.806399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:56.806713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] PATH_INFO: `/v3/projects/704443331dba424b9430b0483bd87cd7` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:56.810545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704443331dba424b9430b0483bd87cd7)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:56.812818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:56.869277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:56.871281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:56.880450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1040/2071] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:03:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:03:56.968183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704443331dba424b9430b0483bd87cd7', 'request_id': 'req-c51f9452-48ca-45d3-8262-253a1bb20b67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:56.979752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704443331dba424b9430b0483bd87cd7', 'request_id': 'req-c51f9452-48ca-45d3-8262-253a1bb20b67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.062693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704443331dba424b9430b0483bd87cd7', 'request_id': 'req-c51f9452-48ca-45d3-8262-253a1bb20b67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.106481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] The token cache is being invalidate because project 704443331dba424b9430b0483bd87cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:57.107180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.111170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c51f9452-48ca-45d3-8262-253a1bb20b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.115079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1032/2072] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:56 2022] DELETE /identity/v3/projects/704443331dba424b9430b0483bd87cd7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:57.121898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:57.138771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af393-df37-4f6b-90fb-9bcd7ef1fa41 service glance] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:57.251798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:57.252546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.252833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.253111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] PATH_INFO: `/v3/users/54963804d20a4bb8ac6e3885d375735b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.254339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54963804d20a4bb8ac6e3885d375735b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:57.256429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:57.286499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.287583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.287914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.325401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:57.325401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.412618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1033/2073] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:03:57.413521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:57.415080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.433167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3027-2577-489b-bd42-7cb6d4b79f99 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:57.440365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:57.441020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.441298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.441572 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] PATH_INFO: `/v3/projects/e7823e1f891a40ae94138025eeaa9a1e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.442738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7823e1f891a40ae94138025eeaa9a1e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:57.444801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:57.534793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54963804d20a4bb8ac6e3885d375735b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.608817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7823e1f891a40ae94138025eeaa9a1e', 'request_id': 'req-86c878c3-519f-4bcd-97b1-22d4b7fed26c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.617368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7823e1f891a40ae94138025eeaa9a1e', 'request_id': 'req-86c878c3-519f-4bcd-97b1-22d4b7fed26c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.632874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54963804d20a4bb8ac6e3885d375735b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.653701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54963804d20a4bb8ac6e3885d375735b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.664712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54963804d20a4bb8ac6e3885d375735b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.665554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54963804d20a4bb8ac6e3885d375735b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.673759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1041/2074] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:57 2022] DELETE /identity/v3/users/54963804d20a4bb8ac6e3885d375735b => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:57.676821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:57.678686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.716593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7823e1f891a40ae94138025eeaa9a1e', 'request_id': 'req-86c878c3-519f-4bcd-97b1-22d4b7fed26c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.738669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] The token cache is being invalidate because project e7823e1f891a40ae94138025eeaa9a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:57.739029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.740777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-86c878c3-519f-4bcd-97b1-22d4b7fed26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:57.749071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1034/2075] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:57 2022] DELETE /identity/v3/projects/e7823e1f891a40ae94138025eeaa9a1e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:57.752449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461741-d2c3-47c8-a894-87dfa12fd5e7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.752741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461741-d2c3-47c8-a894-87dfa12fd5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.753017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39461741-d2c3-47c8-a894-87dfa12fd5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.799666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-39461741-d2c3-47c8-a894-87dfa12fd5e7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:57.801539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-39461741-d2c3-47c8-a894-87dfa12fd5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.806661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:57.853302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b5e5e-3478-4e78-82ea-1cec728e20e8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:57.865295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:57.866112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.866406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.866773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.868711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.896546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1035/2076] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:57.906161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:57.906450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:57.907352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:57.915772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:57.974343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:57.978632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:57.988666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1036/2077] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:57.993120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.007663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb6c0-b1a9-4001-8d9e-88645da967ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.014779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.015216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.015647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.016015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.016515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.017745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:58.018009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.018152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.019929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.029657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1042/2078] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:03:58.037119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1037/2079] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:03:58.042428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.063147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a46f0-c730-4233-a81f-f67f8df70b08 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.083327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.086847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.086847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.086847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.086847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.087409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.211900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1043/2080] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:58 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:58.216155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.235314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7dab5-19eb-4b28-b11d-1e4e3b9e5b49 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.376492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.377210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.377553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.377886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.378900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.381275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.506270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1038/2081] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:58 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:58.510290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.522066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.523937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:58.536091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137ca5b-da4c-4d71-abbe-aee46ed67dd9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.549750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.553945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.554213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.554707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.560499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.565264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade6221-07a5-48c7-b6d2-5d95e826fa86 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.569004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.575474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.576428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.576918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.577775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] PATH_INFO: `/v3/projects/5591d656e54a4a278dfa322a6528dbb5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.580294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5591d656e54a4a278dfa322a6528dbb5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.582472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.613520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1044/2082] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:58.617825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.639527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f029e-9c86-4d52-b19c-2dc53462c82c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.647303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.648101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.648843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.649372 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.650179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.654065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.705722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1045/2083] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:58.707430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:58.729528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5591d656e54a4a278dfa322a6528dbb5', 'request_id': 'req-4e2c5caa-516b-483d-9acf-3b23b770184c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:58.744612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5591d656e54a4a278dfa322a6528dbb5', 'request_id': 'req-4e2c5caa-516b-483d-9acf-3b23b770184c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:58.759331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6c23-8742-4b5f-86fd-7a1edcba8934 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:58.850225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5591d656e54a4a278dfa322a6528dbb5', 'request_id': 'req-4e2c5caa-516b-483d-9acf-3b23b770184c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:58.852646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:58.853378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.860861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.860861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] PATH_INFO: `/v3/projects/3c36d11cc9ee4503a3be1d4c1becaa86/users/9710b45dc6c24804b654222e60d144f9/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.877170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c36d11cc9ee4503a3be1d4c1becaa86, user_id=9710b45dc6c24804b654222e60d144f9, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:58.880775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:58.882982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] The token cache is being invalidate because project 5591d656e54a4a278dfa322a6528dbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:03:58.884930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:58.885899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4e2c5caa-516b-483d-9acf-3b23b770184c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:03:58.887918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1039/2084] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:03:58 2022] DELETE /identity/v3/projects/5591d656e54a4a278dfa322a6528dbb5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:58.896268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac024bf-0729-4304-8c9f-0899f9c4ea8b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.896550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac024bf-0729-4304-8c9f-0899f9c4ea8b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.897015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac024bf-0729-4304-8c9f-0899f9c4ea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.933648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3ac024bf-0729-4304-8c9f-0899f9c4ea8b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:58.935255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3ac024bf-0729-4304-8c9f-0899f9c4ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:58.950136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1040/2085] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:58.958222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:58.958624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:58.958965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:58.966749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:58.990488 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:58.991738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:59.002681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1041/2086] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:59.004097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.014329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c133-3ae9-4f61-9dc3-2bb245742718 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.019582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.020196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.020539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.020812 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.021477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:03:59.021769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.023402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964ef57-8bd9-4dba-a354-02b6c5ba4959 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.029492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1046/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:58 2022] PUT /identity/v3/projects/3c36d11cc9ee4503a3be1d4c1becaa86/users/9710b45dc6c24804b654222e60d144f9/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:03:59.040650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1042/2088] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:03:59.053511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.054489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.055136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.055512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.091309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] MFA Rules not processed for user `9710b45dc6c24804b654222e60d144f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:03:59.092767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:59.144342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aa7e9-b795-483a-aada-b4c0cdcdba6d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.150605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.151172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.151454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.152764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.154510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.161371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.190944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1043/2089] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:03:59.195233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.196660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:59.221751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad99e09-08c1-450b-9398-3c30e437096a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.227121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.227865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.228244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.228660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.230312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.232555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.269138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1047/2090] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:59 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:59.273244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.360340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1044/2091] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:03:59 2022] POST /identity/v3/projects => generated 401 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:59.361334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.388078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557c2eb-0ccc-4067-9c27-b36645e2edc8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.448297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:03:59.509319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82a40-2c3d-48e5-88b9-8f989f701881 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.519609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.520594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.520875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.521149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.521793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.525520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.526153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.526437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.527346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.530451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.531934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.537949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.660152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1048/2092] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:59 2022] POST /identity/v3/users => generated 288 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:03:59.667686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.680303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1045/2093] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:03:59 2022] POST /identity/v3/users => generated 307 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:03:59.681386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.695997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea278-858c-45c8-8072-2f2a059562e0 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.709365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee171d-47a7-4f75-a095-4a1cccab1fe6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.715256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.715891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.716170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.719531 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.720746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.722991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.724847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.735337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.739521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.741773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.742843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.746831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.781108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1049/2094] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:59.797783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1046/2095] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:59.801365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.802320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.829565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb743c-d2c3-456b-a6be-ec33dee7098a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.831921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f88c-97ed-4069-9303-a4d8fcf347aa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.928468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.928468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.928468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.928468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] PATH_INFO: `/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42/users/76a5b725224645fc804501fbb89b57bc/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.929272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.929272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.929272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.929272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.929618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.929618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.929742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd43eb5c59c44bc88e1a47a68f66f42, user_id=76a5b725224645fc804501fbb89b57bc, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.929813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1047/2096] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:03:59.929888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:03:59.938923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:03:59.952477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:03:59.966826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74f8c4-2964-4692-8cd3-2ecc5ceecd84 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:03:59.987794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:03:59.988586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:03:59.989049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:03:59.992185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] PATH_INFO: `/v3/users/60504469d6624f208889df69b24236be` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:03:59.992185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60504469d6624f208889df69b24236be)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:03:59.993067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.072055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:00.080990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1050/2097] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:03:59 2022] PUT /identity/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42/users/76a5b725224645fc804501fbb89b57bc/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:00.082036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.218266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76d0f-757d-4a7d-934c-d21a17ac6922 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.224275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.224935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.225219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.225489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] PATH_INFO: `/v3/projects/b1482368d84345fd80bdcb5999f94dde/users/270d9d5ff95a424ebbc6e11ac0ffb792/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.243217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1482368d84345fd80bdcb5999f94dde, user_id=270d9d5ff95a424ebbc6e11ac0ffb792, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.246630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.281079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60504469d6624f208889df69b24236be'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:00.322541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1051/2098] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:00 2022] PUT /identity/v3/projects/b1482368d84345fd80bdcb5999f94dde/users/270d9d5ff95a424ebbc6e11ac0ffb792/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:00.324407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.384393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60504469d6624f208889df69b24236be'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:00.403789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60504469d6624f208889df69b24236be'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:00.426947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60504469d6624f208889df69b24236be'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:00.427708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cbba408f-fcfa-4611-aa36-7c59d901440a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60504469d6624f208889df69b24236be'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:00.439519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1048/2099] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:03:59 2022] DELETE /identity/v3/users/60504469d6624f208889df69b24236be => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:00.446754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.446754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.446754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.493935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd633a5-06e2-45c6-8c21-9e2fc523606a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.507870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] MFA Rules not processed for user `270d9d5ff95a424ebbc6e11ac0ffb792`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:00.512191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.566431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:00.579963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.580860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.581319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.581595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.582264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.583938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702498a-c040-42d2-87cf-be01751b87a8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.603532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1052/2100] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:00.604873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.605684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.605956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.611057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1049/2101] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:00.612169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.613961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.629253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:00.636285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.636414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9e73-2f96-49c8-99cf-4d494216a12a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.637578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.638353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.638690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.639118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] PATH_INFO: `/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42/users/76a5b725224645fc804501fbb89b57bc/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.639772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1053/2102] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:00.640709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.642229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.644692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd43eb5c59c44bc88e1a47a68f66f42, user_id=76a5b725224645fc804501fbb89b57bc, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.647775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.657197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca05e8-0b2d-49e9-8936-0e25750fa7ac None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.662952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1050/2103] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:00 2022] PUT /identity/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42/users/76a5b725224645fc804501fbb89b57bc/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:00.663998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.665596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.740439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.741309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.741770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.742045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.742727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.744634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.745778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:00.751192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3904786-25a5-4f17-b488-8a12a7cd1382 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.764795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.764795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.764795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.764795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.774197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:00.780229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.780229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c91e9-4f13-4d0e-8b0c-1efba27341e6 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.793120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1051/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:00.794600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.794987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.795654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.848162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1054/2105] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:00.852986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:00.888995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] MFA Rules not processed for user `76a5b725224645fc804501fbb89b57bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:00.890588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:00.975364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9dde5-0869-4d31-b6f0-2938d467ab94 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:00.980702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:00.981567 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:00.981923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:00.982270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:00.983189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:00.985873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:00.993458 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.057202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1052/2106] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:01.081799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.083756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.099005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1055/2107] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:00 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:01.102669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.123383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293aa-1e84-4eee-ad94-4a9234ee31bb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.134863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.135285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.135669 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.135945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.137429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.142262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.158046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1056/2108] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:01.161157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.173962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998fa5-9f38-4eae-be5b-adf7d30f5bf8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.180749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.181368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.181641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.182065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.204200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.209849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.244532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157130-dd68-44a2-aec1-fe8dcfd23e54 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.261015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.261015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.261015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.261015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.274236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1057/2109] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:01.278412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.284613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.302246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ff065-d125-4516-ad23-ffff054f1677 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.305876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.308611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1382cca-0681-43e5-8d82-09e492fd0d31 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.309794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.310752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.311028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.311301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] PATH_INFO: `/v3/projects/6cba3bad82644908859ee2de57a30793/users/eb654a9a5b5340b5a7e23ec21cb6a002/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.334058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cba3bad82644908859ee2de57a30793, user_id=eb654a9a5b5340b5a7e23ec21cb6a002, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.334936 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1053/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:01.351523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.454574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1058/2111] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:01 2022] PUT /identity/v3/projects/6cba3bad82644908859ee2de57a30793/users/eb654a9a5b5340b5a7e23ec21cb6a002/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:01.469336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.469336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.469336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.530753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] MFA Rules not processed for user `eb654a9a5b5340b5a7e23ec21cb6a002`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:01.532068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.612931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.614812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.678491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1054/2112] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:01.679879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.746700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:01.779978 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e058-0410-42b9-b4ca-ed8b81886211 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.788763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.789010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.789261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.789533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] PATH_INFO: `/v3/projects/ed74bcbacd444b93896520a8f21388f3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.790855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed74bcbacd444b93896520a8f21388f3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.793405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.801213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128763-e97d-4568-9b9b-0de74915c0aa None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:01.811132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:01.815430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:01.815917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:01.816351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:01.821447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:01.942174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:01.943969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:01.944644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed74bcbacd444b93896520a8f21388f3', 'request_id': 'req-a9621eae-2799-4537-bbb5-95007c573841'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:01.955892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed74bcbacd444b93896520a8f21388f3', 'request_id': 'req-a9621eae-2799-4537-bbb5-95007c573841'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:01.961439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1055/2113] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:01.962164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:01.975635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55477b4-1ecf-4fa5-a1a8-0f25cc7cf60d service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.037548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed74bcbacd444b93896520a8f21388f3', 'request_id': 'req-a9621eae-2799-4537-bbb5-95007c573841'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:02.084933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] The token cache is being invalidate because project ed74bcbacd444b93896520a8f21388f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:02.085528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:02.087919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a9621eae-2799-4537-bbb5-95007c573841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:02.102370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.103209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1059/2114] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:01 2022] DELETE /identity/v3/projects/ed74bcbacd444b93896520a8f21388f3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:02.103339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.103695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.104045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.105582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.107632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.109132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5224e0-0cc7-43ac-8b84-682228f2ed89 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.110176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5224e0-0cc7-43ac-8b84-682228f2ed89 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.115696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5224e0-0cc7-43ac-8b84-682228f2ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.140954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:02.160009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fb5224e0-0cc7-43ac-8b84-682228f2ed89 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:02.161671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fb5224e0-0cc7-43ac-8b84-682228f2ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:02.175817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1060/2115] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:02.185511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.186039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.186504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.218419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:02.220195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:02.232487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1061/2116] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:04:02.233795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.243636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528670-cff4-4bd2-b04d-66ddaca540db None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.252923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.253937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.254402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.254719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.255385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:04:02.255694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.256783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1056/2117] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:01 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:02.257630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.271361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.272571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1062/2118] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:04:02.278570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.283026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:02.308012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a570-6e4a-4748-b64b-ec6f7eda3a84 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.391482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1719088-294a-40e8-8a7e-f5c0c712ad8e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.396841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.397519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.397802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.398172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.398987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.404766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.456762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.456762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.456762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.456762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.457480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.457480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.491458 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1057/2119] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:02 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:02.495382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.524143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f05ed-406e-4319-affb-8e5e173a95e6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.550209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.550859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.551403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.551725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.552379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.557786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.582794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1058/2120] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:04:02.583483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1063/2121] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:02 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:02.588067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.591324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.612066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf3b52-9b43-457a-943c-c6d921e57218 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.706920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769600e-5f97-4991-86ed-7a2f55b8f06d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.716214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.717844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.718171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.718913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.721395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.724827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.752762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.753516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.753875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.754092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] PATH_INFO: `/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8/users/a8f6f25240f54186b39c6f563dd23e6c/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.837031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69a2e20cbe0454a908c94c8c89cd1b8, user_id=a8f6f25240f54186b39c6f563dd23e6c, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.844269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.902723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1064/2122] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:02 2022] POST /identity/v3/users => generated 286 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:04:02.915118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.923463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01071-a09d-4715-844d-d1c57f087081 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.929753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.931014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.931636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.931968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.932691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.935300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:02.959321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1065/2123] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:02.965834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:02.979297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30430488-e4c5-460e-bc9d-12e8090eda9e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:02.985729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:02.987386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:02.990100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:02.990100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:02.990100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:02.992037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.006262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1066/2124] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:03.010079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:03.025432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117922d-3134-412c-b5d5-e2f9a3ab9234 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:03.034122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:03.036757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.036757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.036757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] PATH_INFO: `/v3/projects/86c3d573598345da9d30423701d32c92/users/2fe33635ea3b4ad48169a791d30d297d/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.062353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c3d573598345da9d30423701d32c92, user_id=2fe33635ea3b4ad48169a791d30d297d, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:03.065032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb029919-0c51-4518-81b2-9b1415e1a95b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.097065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1059/2125] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:02 2022] PUT /identity/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8/users/a8f6f25240f54186b39c6f563dd23e6c/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:03.101203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:03.188017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bdb5c-a2f8-4826-ae28-0b0bb764bbb6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:03.194708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1067/2126] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:03 2022] PUT /identity/v3/projects/86c3d573598345da9d30423701d32c92/users/2fe33635ea3b4ad48169a791d30d297d/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:04:03.196213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.196504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.196784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.223903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:03.225568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:03.276213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:03.276807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.277194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.277367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.278020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:03.279813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.291836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1060/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:03.296401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:03.302574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1068/2128] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:03.307835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e14f-96ab-4153-9bcd-1e799ae98000 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:03.311709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:03.316091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:03.319918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:03.320098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.320664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.320784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] PATH_INFO: `/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8/users/a8f6f25240f54186b39c6f563dd23e6c/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.328925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69a2e20cbe0454a908c94c8c89cd1b8, user_id=a8f6f25240f54186b39c6f563dd23e6c, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:03.331832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c42e6-9ce7-4497-aeb4-96ae32555ace admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.345805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1061/2129] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:03 2022] PUT /identity/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8/users/a8f6f25240f54186b39c6f563dd23e6c/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:03.354479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.354867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.355667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.383407 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71151a10-998a-4a4e-a8ed-dc3af99ad65f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:03.385087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] MFA Rules not processed for user `a8f6f25240f54186b39c6f563dd23e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:03.386418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:03.430903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:03.454938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:03.455649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.455998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.456334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.480864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1062/2130] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:04:03.499398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:03.501443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:03.525362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:03.527386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.538187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1069/2131] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:04:03.580294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5ac6-0157-4b67-a7e8-4c6fc240ce64 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:03.583914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:03.584464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:03.584740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:03.585016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:03.586767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:03.645847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:03.648134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:03.657887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1063/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:04:04.683521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:05.696615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:06.002750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:06.004641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:06.024011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c6e30-49ad-4a77-b873-542500aaf2e7 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:06.034304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:06.035815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:06.036314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:06.036790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:06.040671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:06.151247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:06.156875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:06.184547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1070/2133] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:06.369609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:07.869700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:08.516466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:08.527752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1f70-3bbf-4a30-9e79-496c757b20fd service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:08.532183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:08.532851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:08.533207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:08.533547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:08.544920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:08.547019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fdb1c-6d54-4e3b-9221-d9c72870124a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:08.559845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1064/2134] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:09.088610 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:09.607973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:09.609446 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:09.646654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c17d8-dc2c-47a3-9b0c-d612b12bd493 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:09.666182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:09.666871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:09.667192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:09.669549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] PATH_INFO: `/v3/users/9710b45dc6c24804b654222e60d144f9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:09.671084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9710b45dc6c24804b654222e60d144f9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:09.674280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:09.934370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9710b45dc6c24804b654222e60d144f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:10.032053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9710b45dc6c24804b654222e60d144f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:10.059422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9710b45dc6c24804b654222e60d144f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:10.073905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9710b45dc6c24804b654222e60d144f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:10.075421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9710b45dc6c24804b654222e60d144f9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:10.089508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1071/2135] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:09 2022] DELETE /identity/v3/users/9710b45dc6c24804b654222e60d144f9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:10.094444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:10.095018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:10.095273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:10.112108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:10.134420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:10.137673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:10.249190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1065/2136] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:10.265823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:10.267487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:10.389367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97a9da-0544-4e0a-9247-732c915d30c2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:10.397884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:10.399116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:10.399599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:10.400955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:10.435599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:10.437271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:10.461940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1072/2137] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:11.019759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:11.402946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:11.698089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:11.699757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:11.720830 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9a92e-5cca-454d-855e-4018ef3740f2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:11.746389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:11.747829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:11.748286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:11.748728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] PATH_INFO: `/v3/projects/3c36d11cc9ee4503a3be1d4c1becaa86` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:11.753674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c36d11cc9ee4503a3be1d4c1becaa86)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:11.753674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:11.958666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c36d11cc9ee4503a3be1d4c1becaa86', 'request_id': 'req-daef2b78-cd0d-422a-a218-c244af25013d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:11.980039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c36d11cc9ee4503a3be1d4c1becaa86', 'request_id': 'req-daef2b78-cd0d-422a-a218-c244af25013d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.072020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c36d11cc9ee4503a3be1d4c1becaa86', 'request_id': 'req-daef2b78-cd0d-422a-a218-c244af25013d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.110837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] The token cache is being invalidate because project 3c36d11cc9ee4503a3be1d4c1becaa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:12.111454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.115343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.118813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1066/2138] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:11 2022] DELETE /identity/v3/projects/3c36d11cc9ee4503a3be1d4c1becaa86 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:12.123180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:12.138021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804420-0d42-4ca3-aa43-3f316143a5a6 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:12.307369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:12.309088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:12.309796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:12.311046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] PATH_INFO: `/v3/users/76a5b725224645fc804501fbb89b57bc` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:12.312883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a5b725224645fc804501fbb89b57bc)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:12.318189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:12.621931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a5b725224645fc804501fbb89b57bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.699043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:12.725132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a5b725224645fc804501fbb89b57bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.748761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a5b725224645fc804501fbb89b57bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.760579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a5b725224645fc804501fbb89b57bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.763417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d57a2239-06ea-4bc7-aa46-e84c5921da3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a5b725224645fc804501fbb89b57bc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:12.781546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1073/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:12 2022] DELETE /identity/v3/users/76a5b725224645fc804501fbb89b57bc => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:13.248588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:13.529305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:13.530939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:13.557392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef2b78-cd0d-422a-a218-c244af25013d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:13.716561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:13.717716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:13.718258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:13.718778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] PATH_INFO: `/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:13.721039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd43eb5c59c44bc88e1a47a68f66f42)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:13.724216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:13.740747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:13.799398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:13.802467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:13.803278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:13.903551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] MFA Rules not processed for user `2fe33635ea3b4ad48169a791d30d297d`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:13.903691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd43eb5c59c44bc88e1a47a68f66f42', 'request_id': 'req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:13.909006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:13.911451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd43eb5c59c44bc88e1a47a68f66f42', 'request_id': 'req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:14.012146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd43eb5c59c44bc88e1a47a68f66f42', 'request_id': 'req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:14.078095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] The token cache is being invalidate because project 9cd43eb5c59c44bc88e1a47a68f66f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:14.078639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:14.087588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-010cfa3e-356e-4837-a0c5-1b95c0c3d3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:14.098115 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1067/2140] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:13 2022] DELETE /identity/v3/projects/9cd43eb5c59c44bc88e1a47a68f66f42 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:14.105534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:14.106958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:14.107689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:14.178771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1074/2141] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:14.178771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:14.180529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:14.192560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:14.194099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:14.244380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:14.326170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1068/2142] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:14.327257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:14.328996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:14.342729 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba76db-0add-4395-aaf7-c4651235b416 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:14.346701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffc605-f5f0-4a42-903a-405449a02ffb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:14.353402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:14.353824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:14.355109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:14.355809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:14.356156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:14.356498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:14.356891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:14.357660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] PATH_INFO: `/v3/users/270d9d5ff95a424ebbc6e11ac0ffb792` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:14.358608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:14.360959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=270d9d5ff95a424ebbc6e11ac0ffb792)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:14.363400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58efc5-da92-4532-b9df-b25c2f60769a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:14.365490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:14.787148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1069/2143] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:14 2022] POST /identity/v3/projects => generated 373 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:14.788576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:14.788867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:14.791292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:14.832018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:14.833998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:14.878927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:14.890953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270d9d5ff95a424ebbc6e11ac0ffb792'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:14.949463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1070/2144] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:14.951678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:14.963125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf058f-00fc-4381-9a31-e8d24b12fbd3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:14.970439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:14.971583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:14.972073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:14.972606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:14.973469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:14.978084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd1b21-be12-42d1-aef8-5c656dc3aa2e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:14.983797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270d9d5ff95a424ebbc6e11ac0ffb792'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:15.002773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270d9d5ff95a424ebbc6e11ac0ffb792'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:15.016003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270d9d5ff95a424ebbc6e11ac0ffb792'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:15.017079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270d9d5ff95a424ebbc6e11ac0ffb792'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:15.025404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1075/2145] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:14 2022] DELETE /identity/v3/users/270d9d5ff95a424ebbc6e11ac0ffb792 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:15.027151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.029078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:15.119405 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1071/2146] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:14 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:15.120671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.121051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.121394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.146390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ac25-80a3-4e8f-9881-ceacc599bd6c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.160427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:15.162085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.162812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.163176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.163646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.164385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:04:15.164864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.169916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.170230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:15.192898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1072/2147] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:15.192898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.193916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:15.199146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1076/2148] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:04:15.200289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.225363 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a314-7dc3-4a1e-b63a-971d3840bfd9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.226331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a14d6-4a50-4d0a-8170-7617669b85ea None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.234567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.235506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.235895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.236177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.237002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.237773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.238600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.242866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.242991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.242991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.242991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.248587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.251213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1073/2149] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:15.252227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.253962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:15.404664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1077/2150] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:15 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:15.405913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.450454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57456-ecf8-4b79-a056-bfd09c7b4618 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.451825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:15.596616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:15.597759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81284690-b01f-41b0-ac43-a8d7d4be3380 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.623529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.624149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.624433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.624712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] PATH_INFO: `/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969/users/9890d228f7b54cad819f65a96f10e12f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.637098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.638106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.638385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.638715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.649374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.650898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.662834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1074/2151] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:15.682411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.690762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c663e2c5d31d442c8e1035fdd2cbd969, user_id=9890d228f7b54cad819f65a96f10e12f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.700257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.704960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556b87-feac-4644-8a1f-d8edb9bc6002 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.719301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.720144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.720474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.721828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.724408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.727354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.746329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:15.779784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1078/2152] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:15 2022] PUT /identity/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969/users/9890d228f7b54cad819f65a96f10e12f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:15.785248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.888364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1075/2153] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:15 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:15.889864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:15.927496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c49eb-386b-45a9-940d-99bc87f15c63 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.958845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.958845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.958845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.958845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.959139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:15.965832 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:15.966931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540b7c-ca50-499d-91d5-0b7538dc1b58 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:15.990634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:15.996059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:15.996353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:15.996631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:15.997315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.007749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.011424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1076/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:16.013253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.046094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1079/2155] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:16.050800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.052267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba09970-d109-4404-b593-1f45748cce75 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:16.066735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:16.067656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.068331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.068834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.084193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.092447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.094957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad1663-cf82-4a29-a716-3ac96580d854 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:16.102283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:16.102283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.103480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.108449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] PATH_INFO: `/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969/users/9890d228f7b54cad819f65a96f10e12f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.117850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c663e2c5d31d442c8e1035fdd2cbd969, user_id=9890d228f7b54cad819f65a96f10e12f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.126455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1077/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:16.134353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.134543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.175172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0354b-bb13-4992-9c7b-38ed289e3a80 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:16.182486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1080/2157] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:16 2022] PUT /identity/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969/users/9890d228f7b54cad819f65a96f10e12f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:16.197862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:16.350354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:16.351065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.351349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.351657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] PATH_INFO: `/v3/projects/2c8ce29e71104a4c9c1ba49a5f2320fe/users/f80832e2f57d42ecb9e890793c22eaf2/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.374416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8ce29e71104a4c9c1ba49a5f2320fe, user_id=f80832e2f57d42ecb9e890793c22eaf2, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.378500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13a496-8b71-4c1d-ac12-ce7a1a56ab2a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.545704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.552911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:16.565352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1078/2158] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:16 2022] PUT /identity/v3/projects/2c8ce29e71104a4c9c1ba49a5f2320fe/users/f80832e2f57d42ecb9e890793c22eaf2/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:16.580336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.580928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.581500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.596423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0419-7e5b-4eb3-9cc6-b41bf3af804d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:16.628417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] MFA Rules not processed for user `f80832e2f57d42ecb9e890793c22eaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:16.629799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:16.713035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:16.713702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.714917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.714917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] PATH_INFO: `/v3/projects/b1482368d84345fd80bdcb5999f94dde` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.716283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1482368d84345fd80bdcb5999f94dde)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.718211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.729089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:16.736263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1079/2159] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:16.740548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.754168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1633-0206-49e6-98b4-4e4f54815b2c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:16.761249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:16.762116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:16.768366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:16.768366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:16.768366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:16.768366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:16.854287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1482368d84345fd80bdcb5999f94dde', 'request_id': 'req-bb511092-e037-4035-b0bf-accf2d898810'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:16.869112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1482368d84345fd80bdcb5999f94dde', 'request_id': 'req-bb511092-e037-4035-b0bf-accf2d898810'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:16.892178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1080/2160] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:16 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:16.895632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.962015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1482368d84345fd80bdcb5999f94dde', 'request_id': 'req-bb511092-e037-4035-b0bf-accf2d898810'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:16.977050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] The token cache is being invalidate because project b1482368d84345fd80bdcb5999f94dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:16.980464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:16.981704 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:16.985109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1081/2161] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:16 2022] DELETE /identity/v3/projects/b1482368d84345fd80bdcb5999f94dde => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:16.988760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:16.990561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:17.002659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31b50c-a28f-4fcb-bf91-5bea26d43752 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.007104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.007961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.008317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.008681 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.009450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.011588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d3d9e-0cce-4c1a-b476-ec1112c17e7c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.095705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511092-e037-4035-b0bf-accf2d898810 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.138370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.139254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.139733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.140011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] PATH_INFO: `/v3/users/eb654a9a5b5340b5a7e23ec21cb6a002` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.141666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb654a9a5b5340b5a7e23ec21cb6a002)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.144000 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.178130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1081/2162] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:16 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:17.178130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.178130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.178130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.210825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] MFA Rules not processed for user `9b53d11fc61b44c48054e62b7103ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:17.212135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:17.308436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1082/2163] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:17.310371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:17.312485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:17.372206 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af27297-8280-4be6-a887-e0a242cf65dd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.383843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.384943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.385375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.386603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.387486 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.404119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.434425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1083/2164] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:17.454707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb654a9a5b5340b5a7e23ec21cb6a002'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:17.471627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:17.493376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cbdc2-7901-4d14-a7c4-bad1a4b7497d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.506474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.507935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.508371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.508845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] PATH_INFO: `/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa/users/d1af70bdea9d4468846027354c0f64d5/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.517140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb654a9a5b5340b5a7e23ec21cb6a002'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:17.539659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:17.542214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f49e832e9064fb29f1a892e31b3f7aa, user_id=d1af70bdea9d4468846027354c0f64d5, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.544084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb654a9a5b5340b5a7e23ec21cb6a002'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:17.548360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.551812 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb654a9a5b5340b5a7e23ec21cb6a002'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:17.552662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb654a9a5b5340b5a7e23ec21cb6a002'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:17.563044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1082/2165] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:16 2022] DELETE /identity/v3/users/eb654a9a5b5340b5a7e23ec21cb6a002 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:17.652334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1084/2166] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:17 2022] PUT /identity/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa/users/d1af70bdea9d4468846027354c0f64d5/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:17.653524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:17.655324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:17.765373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf8605-95bf-4f55-9c3b-4b0610777f0f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.881600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.882497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.882948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.883487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.884218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.886505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55f8e5-0250-40ee-ab0e-8f711d90b1e8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.906010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1083/2167] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:17.906197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:17.918312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc733-14ef-4e58-b3a0-d43b91a732db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:17.929102 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:17.930163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.931195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.931840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] PATH_INFO: `/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa/users/d1af70bdea9d4468846027354c0f64d5/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:17.934675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f49e832e9064fb29f1a892e31b3f7aa, user_id=d1af70bdea9d4468846027354c0f64d5, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:17.940926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:17.958160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1085/2168] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:17 2022] PUT /identity/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa/users/d1af70bdea9d4468846027354c0f64d5/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:17.969664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:17.969984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:17.970286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:18.030232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] MFA Rules not processed for user `d1af70bdea9d4468846027354c0f64d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:18.032026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:18.150540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1084/2169] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:18.160375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:18.162822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:18.240455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7a95e-e5c3-41fd-95b6-4cb69fa77578 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:18.244719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:18.246123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:18.246590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:18.251013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:18.268505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:18.269981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:18.300942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1086/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:18.405229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:18.405229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:18.456848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:18.601348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a183-3324-4a8d-86f4-130f57f745c5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:18.607896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:18.611593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:18.611593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:18.611593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] PATH_INFO: `/v3/projects/6cba3bad82644908859ee2de57a30793` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:18.611854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cba3bad82644908859ee2de57a30793)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:18.613963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:18.768965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cba3bad82644908859ee2de57a30793', 'request_id': 'req-a986f996-5779-425c-becb-dc3e643873e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:18.776925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cba3bad82644908859ee2de57a30793', 'request_id': 'req-a986f996-5779-425c-becb-dc3e643873e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:18.859775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cba3bad82644908859ee2de57a30793', 'request_id': 'req-a986f996-5779-425c-becb-dc3e643873e5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:18.878511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] The token cache is being invalidate because project 6cba3bad82644908859ee2de57a30793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:18.878511 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:18.881739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:18.886680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1085/2171] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:18 2022] DELETE /identity/v3/projects/6cba3bad82644908859ee2de57a30793 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:18.888090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:18.904551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc03a1-7c3d-4731-85c0-27d89ad99371 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:19.019902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:19.021023 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:19.021663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:19.022127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] PATH_INFO: `/v3/users/a8f6f25240f54186b39c6f563dd23e6c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:19.023711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f6f25240f54186b39c6f563dd23e6c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:19.027096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:19.285904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f6f25240f54186b39c6f563dd23e6c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:19.379395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f6f25240f54186b39c6f563dd23e6c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:19.398173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f6f25240f54186b39c6f563dd23e6c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:19.408099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f6f25240f54186b39c6f563dd23e6c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:19.409134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f6f25240f54186b39c6f563dd23e6c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:19.423136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1087/2172] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:18 2022] DELETE /identity/v3/users/a8f6f25240f54186b39c6f563dd23e6c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:20.005718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:20.008207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.044081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986f996-5779-425c-becb-dc3e643873e5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:20.053190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:20.174391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:20.177842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.177842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.177842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] PATH_INFO: `/v3/users/f80832e2f57d42ecb9e890793c22eaf2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.177842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80832e2f57d42ecb9e890793c22eaf2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:20.179079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:20.404152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80832e2f57d42ecb9e890793c22eaf2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.408755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:20.410196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.423336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ddeeb-6c2e-45ca-9dbc-b55861b2f60b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:20.428802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:20.429687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.430039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.430396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] PATH_INFO: `/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.431640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69a2e20cbe0454a908c94c8c89cd1b8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:20.433779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:20.491198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80832e2f57d42ecb9e890793c22eaf2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.509308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80832e2f57d42ecb9e890793c22eaf2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.523470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80832e2f57d42ecb9e890793c22eaf2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.524252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c230d145-c79b-4e03-ae37-101d88eb1f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80832e2f57d42ecb9e890793c22eaf2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.532837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1086/2173] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:20 2022] DELETE /identity/v3/users/f80832e2f57d42ecb9e890793c22eaf2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:20.534397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48ef6-1ddc-44e6-86f4-589a0eebcfe3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.534755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48ef6-1ddc-44e6-86f4-589a0eebcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.535723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb48ef6-1ddc-44e6-86f4-589a0eebcfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.564091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9cb48ef6-1ddc-44e6-86f4-589a0eebcfe3 None None] MFA Rules not processed for user `98f0fddb64e04ef39187cbd44fa8d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:20.566732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9cb48ef6-1ddc-44e6-86f4-589a0eebcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.576799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69a2e20cbe0454a908c94c8c89cd1b8', 'request_id': 'req-9db41af4-ca0f-456a-b1ea-1706f1c0a632'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.588533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69a2e20cbe0454a908c94c8c89cd1b8', 'request_id': 'req-9db41af4-ca0f-456a-b1ea-1706f1c0a632'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.669057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1087/2174] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:20.671071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.671436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.672065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.687710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69a2e20cbe0454a908c94c8c89cd1b8', 'request_id': 'req-9db41af4-ca0f-456a-b1ea-1706f1c0a632'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.702032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:20.703453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.710399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] The token cache is being invalidate because project d69a2e20cbe0454a908c94c8c89cd1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:20.711672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.714472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9db41af4-ca0f-456a-b1ea-1706f1c0a632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:20.717730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1088/2175] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:20 2022] DELETE /identity/v3/projects/d69a2e20cbe0454a908c94c8c89cd1b8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:04:20.726383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c971-7f44-4b0f-8d68-5697ef10eefd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.726711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c971-7f44-4b0f-8d68-5697ef10eefd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.728229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1c971-7f44-4b0f-8d68-5697ef10eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.772403 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4db1c971-7f44-4b0f-8d68-5697ef10eefd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:20.773683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4db1c971-7f44-4b0f-8d68-5697ef10eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.803244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1088/2176] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:20.810224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:20.812260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.834381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1089/2177] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:20.842847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.843126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.843423 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.876913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:20.879436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:20.893012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f86a3e-d704-4295-8ce7-9260150aa179 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:20.898221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:20.898887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.899167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.899443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.903376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1090/2178] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:04:20.907596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:20.920131 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:20.921641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695a54-a8cd-4e88-9491-44a6b00d1ed0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:20.921790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:20.927354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:20.928801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.929640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.930058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.931675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:04:20.932976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:20.935199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:20.941292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1089/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:20.951347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1091/2180] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:04:20.956682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:20.967207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffe22-aeee-4fbd-ad4e-f6f6a7bae2ed service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:20.972686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:20.979992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:20.980642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:20.981540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:20.985136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:20.989783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.109357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1090/2181] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:20 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:21.113615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:21.127148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38b09-d0c3-4a85-b533-f8a369a5810c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:21.196976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:21.197592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.197872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.198177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.198850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:21.200879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.291492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1092/2182] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:21 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:21.293885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:21.308551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01679e-faa5-432c-8e4f-7cc220da5695 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:21.321396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:21.322024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.322302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.322596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.323287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:21.324894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.355464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1091/2183] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:21.356517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:21.359226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:21.368903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d53af-48f9-4a65-ae5a-37691d440ead admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:21.384214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:21.385650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.386594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.386845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.387561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:21.389375 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20538593-63bc-4462-b2b7-0fcc603da713 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.418323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1093/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:04:21.424756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:21.447613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd80b8-deb0-4098-ae05-0332d4895212 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:21.460278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:21.461236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.461236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.461488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] PATH_INFO: `/v3/projects/177a9d39d38c490aae2262074a174746/users/cb3c865008c14e61829baefcd84f415a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.493183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177a9d39d38c490aae2262074a174746, user_id=cb3c865008c14e61829baefcd84f415a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:21.498552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.705918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1092/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:21 2022] PUT /identity/v3/projects/177a9d39d38c490aae2262074a174746/users/cb3c865008c14e61829baefcd84f415a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:21.706846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.706846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.706846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.706846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:21.706846 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:21.753442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1094/2186] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:21.771344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:21.773174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:21.864020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311e365-4722-4015-9eed-cc94aac0e876 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:21.868921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:21.869563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:21.869940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:21.870370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:21.882210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:21.884166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14af54a-55f4-4b9f-99e1-84f4f76750f8 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:21.897820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1093/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:21.951147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:22.190591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:22.192607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:22.220001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9455ece-0905-4b6e-a771-24a3288fa3c2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:22.285085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:22.286173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:22.286719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:22.287644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] PATH_INFO: `/v3/projects/2c8ce29e71104a4c9c1ba49a5f2320fe` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:22.294874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8ce29e71104a4c9c1ba49a5f2320fe)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:22.303867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:22.455625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8ce29e71104a4c9c1ba49a5f2320fe', 'request_id': 'req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:22.474853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8ce29e71104a4c9c1ba49a5f2320fe', 'request_id': 'req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:22.579591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8ce29e71104a4c9c1ba49a5f2320fe', 'request_id': 'req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:22.596494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] The token cache is being invalidate because project 2c8ce29e71104a4c9c1ba49a5f2320fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:22.596785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:22.600132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:22.601630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:22.602107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:22.602994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:22.603617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1095/2188] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:22 2022] DELETE /identity/v3/projects/2c8ce29e71104a4c9c1ba49a5f2320fe => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:22.607436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:22.609728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:22.630196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:22.631572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:22.698601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c1f70-2086-423e-8db6-6c1d7b5f6bc1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:22.710931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:22.723422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:22.723724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:22.723957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] PATH_INFO: `/v3/users/d1af70bdea9d4468846027354c0f64d5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:22.725914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1af70bdea9d4468846027354c0f64d5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:22.727902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:22.816342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1094/2189] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:04:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:22.830377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:22.832481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:22.962297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2554ed-dc36-4ef0-b904-551c68458449 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:22.969332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:22.970087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:22.970657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:22.971143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:22.981607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:22.984964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:23.005223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1095/2190] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 12:04:23.048289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1af70bdea9d4468846027354c0f64d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:23.120791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1af70bdea9d4468846027354c0f64d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:23.179447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1af70bdea9d4468846027354c0f64d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:23.200517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1af70bdea9d4468846027354c0f64d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:23.205521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0dce3c33-453b-4b97-a45b-2cc9d9b459a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1af70bdea9d4468846027354c0f64d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:23.218168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1096/2191] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:22 2022] DELETE /identity/v3/users/d1af70bdea9d4468846027354c0f64d5 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:23.327901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:23.629805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:24.605596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:24.624571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73597-eb5e-4e64-828f-7b6a9064a3c3 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:24.645598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:24.646571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:24.647036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:24.723078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] MFA Rules not processed for user `cb3c865008c14e61829baefcd84f415a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:24.727559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:24.818292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:24.818970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:24.819416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:24.819845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] PATH_INFO: `/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:24.823919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f49e832e9064fb29f1a892e31b3f7aa)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:24.826121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:24.920968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1097/2192] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:24.935046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:24.938413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:24.990869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:24.998692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f49e832e9064fb29f1a892e31b3f7aa', 'request_id': 'req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:25.032690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f49e832e9064fb29f1a892e31b3f7aa', 'request_id': 'req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:25.040370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec6a02-d4f6-4753-9ac2-b353adc2ee26 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:25.053272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:25.117309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:25.118316 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.118978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.120025 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.128044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f49e832e9064fb29f1a892e31b3f7aa', 'request_id': 'req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:25.152483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] The token cache is being invalidate because project 2f49e832e9064fb29f1a892e31b3f7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:25.153089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:25.154278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7a305f1e-ae0d-4c5b-8004-f3f4d2efe06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:25.156687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1096/2193] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:24 2022] DELETE /identity/v3/projects/2f49e832e9064fb29f1a892e31b3f7aa => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:25.169195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.169195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.169195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.188249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:25.189621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:25.223694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:25.227513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80c1b5-2dd9-42cb-99af-ca7e4eca804c service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:25.260874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1098/2194] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:25.280490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1097/2195] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:25.292421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.292701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.292973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.396466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:25.400190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:25.410193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1099/2196] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:25.414546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:25.436662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cabb2-097a-4b4f-854b-4798a2cecb10 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:25.451365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:25.452643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.452643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.452834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.454489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:04:25.455702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:25.462038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:25.501689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1098/2197] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:04:25.503016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:25.519280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0ad8f-2a55-4b4c-8267-5483e324925e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:25.530332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:25.531051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.531376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.531698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.534376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:25.538636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:25.669751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:25.680719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1100/2198] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:25 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:25.688282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca408-19d1-4482-a309-e1d499a18665 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:25.806971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:25.812186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:25.812660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:25.812944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:25.813619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:25.818784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:26.004260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1099/2199] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:25 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:26.018420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:26.031234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5659-fc7a-4f3d-8d07-c53d5d9a7a37 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:26.037138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:26.037949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:26.038410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:26.039069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:26.039892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:26.043944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:26.055234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1101/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:26.059358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:26.077943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267d23-bd86-4665-9eb6-366770c01483 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:26.095621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:26.096301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:26.096580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:26.096852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:26.097560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:26.099735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2fd5f-db13-482e-8076-7113b431f14b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:26.132360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1100/2201] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:26.136380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:26.160351 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421835d-0024-4d12-91ea-b87d57f22e99 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:26.179252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a789-6431-4501-9848-aab84095600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:26.180141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a789-6431-4501-9848-aab84095600d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:26.180591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a789-6431-4501-9848-aab84095600d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:26.181185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a789-6431-4501-9848-aab84095600d admin admin] PATH_INFO: `/v3/projects/8dfccbf12d8c43bc86882fd3b65f9826/users/1b56c26327994f78a66350eeaaeade7d/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:26.225873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a789-6431-4501-9848-aab84095600d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfccbf12d8c43bc86882fd3b65f9826, user_id=1b56c26327994f78a66350eeaaeade7d, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:26.230929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a789-6431-4501-9848-aab84095600d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:26.305449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:26.335499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1102/2202] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:26 2022] PUT /identity/v3/projects/8dfccbf12d8c43bc86882fd3b65f9826/users/1b56c26327994f78a66350eeaaeade7d/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:26.343772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aae82-5888-4ae8-9399-2a8e8979a549 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:26.345106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aae82-5888-4ae8-9399-2a8e8979a549 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:26.346135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aae82-5888-4ae8-9399-2a8e8979a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:26.448887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-592aae82-5888-4ae8-9399-2a8e8979a549 None None] MFA Rules not processed for user `1b56c26327994f78a66350eeaaeade7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:26.452521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-592aae82-5888-4ae8-9399-2a8e8979a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:26.535592 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:26.638084 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1101/2203] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:26.638449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a789-6431-4501-9848-aab84095600d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:26.642533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f890a789-6431-4501-9848-aab84095600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:26.767534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a789-6431-4501-9848-aab84095600d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:26.773600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:26.775146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:26.775708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:26.776320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:26.791259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:26.792999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:26.810207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1103/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:27.335120 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9212-af07-4e50-83a2-fddaa8b9dc27 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:27.336058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9212-af07-4e50-83a2-fddaa8b9dc27 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:27.336498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b9212-af07-4e50-83a2-fddaa8b9dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:27.418933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f18b9212-af07-4e50-83a2-fddaa8b9dc27 None None] MFA Rules not processed for user `9890d228f7b54cad819f65a96f10e12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:27.420552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f18b9212-af07-4e50-83a2-fddaa8b9dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:27.596338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1102/2205] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:27.853090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:27.855616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:28.015107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05dc67-cc7b-4585-a695-07b445c1feef service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:28.023220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:28.023220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:28.023220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:28.023220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:28.024253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:28.092957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:28.097422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7186-aaab-4f3e-9909-0f2af84fe026 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:28.112877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1104/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:28.464951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:28.532142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a22-adff-4d9a-b997-c2715e30f35d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:28.538007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a22-adff-4d9a-b997-c2715e30f35d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:28.538007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a22-adff-4d9a-b997-c2715e30f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:28.571821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-546a9a22-adff-4d9a-b997-c2715e30f35d None None] MFA Rules not processed for user `cb3c865008c14e61829baefcd84f415a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:28.575823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-546a9a22-adff-4d9a-b997-c2715e30f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:28.658845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1103/2207] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:28.762603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:30.186225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:31.195981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:31.448551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:31.992445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf1591-f792-4ab5-b22b-487a2f61b0fc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:31.992918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf1591-f792-4ab5-b22b-487a2f61b0fc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:31.993339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf1591-f792-4ab5-b22b-487a2f61b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:32.014000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1ebf1591-f792-4ab5-b22b-487a2f61b0fc None None] MFA Rules not processed for user `2fe33635ea3b4ad48169a791d30d297d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:32.015547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1ebf1591-f792-4ab5-b22b-487a2f61b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:32.028852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1105/2208] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:35.568087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:35.568683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:35.568683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:35.592050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] MFA Rules not processed for user `601eeaeae5024d48a762049ecbc3bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:35.593291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:35.622788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:35.650158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1104/2209] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:41.677293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:41.678067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:41.678810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:41.702560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:41.704090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:41.774466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1106/2210] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:41.792087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:41.794266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:41.910047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad230a1d-d717-4fcc-bcd6-e72eab76d99d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:41.916764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:41.918623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:41.919062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:41.919540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:41.930858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:41.932475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79833c16-3985-4703-acfb-77708a0d30e3 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:41.944180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1105/2211] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:04:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:04:45.712471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:45.841513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a1718-0efd-4cd4-9830-f613d7374f63 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:45.847185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:45.847912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:45.848439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:45.848773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] PATH_INFO: `/v3/users/1b56c26327994f78a66350eeaaeade7d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:45.850044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b56c26327994f78a66350eeaaeade7d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:45.852321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:45.951287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:46.053740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b56c26327994f78a66350eeaaeade7d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:46.139629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b56c26327994f78a66350eeaaeade7d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:46.165890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b56c26327994f78a66350eeaaeade7d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:46.176730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b56c26327994f78a66350eeaaeade7d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:46.177646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b56c26327994f78a66350eeaaeade7d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:46.184892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1107/2212] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:04:45 2022] DELETE /identity/v3/users/1b56c26327994f78a66350eeaaeade7d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:46.189287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:46.189834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:46.192262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:46.233653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:46.244264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:46.395405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1106/2213] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:46.406308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:46.407865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:46.515208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6f8b-8fb9-4698-a697-be342ccf166c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:46.521398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:46.522170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:46.523286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:46.523573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:46.534923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:46.536478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fc526-c3af-444c-89ae-14481b82cb10 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:46.547348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1108/2214] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:04:47.220765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:47.222265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:47.238867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997275-64e7-42fd-ae09-5a864a388d47 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:47.253657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:47.254319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:47.254624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:47.256620 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] PATH_INFO: `/v3/projects/8dfccbf12d8c43bc86882fd3b65f9826` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:47.257148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfccbf12d8c43bc86882fd3b65f9826)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:47.258744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:47.412648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfccbf12d8c43bc86882fd3b65f9826', 'request_id': 'req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:47.421406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfccbf12d8c43bc86882fd3b65f9826', 'request_id': 'req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:47.488048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfccbf12d8c43bc86882fd3b65f9826', 'request_id': 'req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:47.491169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:47.511998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] The token cache is being invalidate because project 8dfccbf12d8c43bc86882fd3b65f9826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:04:47.512639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:47.513683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d8a1c8ff-5426-4fd4-8f80-b6960c0403c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:04:47.521171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:47.522100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:47.523011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:47.525807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1107/2215] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:04:47 2022] DELETE /identity/v3/projects/8dfccbf12d8c43bc86882fd3b65f9826 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:47.547740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:47.550777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:47.646368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1109/2216] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:47.654784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:47.654892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:47.655189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:47.677793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:47.679661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:47.691064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1108/2217] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:47.695310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:47.708755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a687b-5a05-492f-8c05-f2f1ba8df2f7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:47.713905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:47.714713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:47.714999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:47.715444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:47.716192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:04:47.716502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:47.718098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:47.734366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1110/2218] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:04:47.739081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:47.751712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a22e-2a6b-4f8b-bd5a-1a1efc0173c6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:47.757371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:47.758028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:47.758932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:47.759212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:47.760048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:47.762615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:47.901056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1109/2219] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:04:47 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:04:47.905522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:47.920500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf520a6-6ea7-409d-9c01-4f7c8f1a0fbb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:47.961884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:48.007120 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:48.007736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.008011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.008281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.008903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:48.010901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:48.123533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1111/2220] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:04:47 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:04:48.127334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:48.143693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd06bf-e494-4676-83d1-dbbfeffb5317 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:48.150103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:48.150803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.151100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.151607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.152389 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:48.154065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:48.168013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1110/2221] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:48.171546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:48.183978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822d46-4cb7-4d62-aaeb-a1d18877a242 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:48.189388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:48.189843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.190198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.190567 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.191320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:48.193278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607727b4-74c3-41f7-878b-30866cbfdb55 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:48.210036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:48.221261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7ee9c-c0e5-43ca-98d3-6f9a02b96fcd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:48.222039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1112/2222] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:04:48.226256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:48.227043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.227324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.227703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] PATH_INFO: `/v3/projects/8b885fa4a4bf4fbf9ec3281398c7d2ce/users/97a1fa5d20614b09bd0c0d93655752d3/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.245685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b885fa4a4bf4fbf9ec3281398c7d2ce, user_id=97a1fa5d20614b09bd0c0d93655752d3, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:48.248502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:48.333921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.334209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.334490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.337548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1111/2223] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:04:48 2022] PUT /identity/v3/projects/8b885fa4a4bf4fbf9ec3281398c7d2ce/users/97a1fa5d20614b09bd0c0d93655752d3/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:04:48.365532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] MFA Rules not processed for user `97a1fa5d20614b09bd0c0d93655752d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:04:48.368678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:48.439516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1113/2224] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:04:48.450412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:04:48.454486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:04:48.526942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b598088-109a-4eca-b207-3c6774448de0 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:04:48.534346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:04:48.535147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:04:48.535529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:04:48.535904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:04:48.545738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:04:48.549366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:04:48.560778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1112/2225] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:04:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:04:58.436066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:04:58.554992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:00.483949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:00.485444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:00.547564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42d88-b52a-4b4d-83b3-a851a0eb3926 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:00.551973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:00.552588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:00.552871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:00.553147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:00.555827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:00.642762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:00.644432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5e017-589d-4625-b5f2-e6d821f12a70 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:00.656400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1114/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:05:02.071290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:02.167092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58fc72-adc6-425e-86e2-91510f76f0ec service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:02.176799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:02.177890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:02.178244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:02.178612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] PATH_INFO: `/v3/users/97a1fa5d20614b09bd0c0d93655752d3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:02.180427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a1fa5d20614b09bd0c0d93655752d3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:02.183580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:02.376694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a1fa5d20614b09bd0c0d93655752d3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:02.445423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a1fa5d20614b09bd0c0d93655752d3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:02.464954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a1fa5d20614b09bd0c0d93655752d3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:02.475919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a1fa5d20614b09bd0c0d93655752d3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:02.476184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a1fa5d20614b09bd0c0d93655752d3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:02.483673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1113/2227] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:05:02 2022] DELETE /identity/v3/users/97a1fa5d20614b09bd0c0d93655752d3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:05:02.489388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:02.490052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:02.490052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:02.640203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:02.641356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:02.700365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1115/2228] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:02.709802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:02.711241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:02.777534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed161b6-db4c-4daf-964e-1f3e965114a2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:02.781301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:02.781944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:02.782222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:02.782493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:02.792192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:02.793618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fb06a-7b6d-4834-b6a9-6a7c11022f9a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:02.803587 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1114/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:03.410212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:03.411865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:03.425150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddbfda-ff1b-433c-9437-e20f8080074d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:03.436743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:03.437752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:03.438026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:03.438384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] PATH_INFO: `/v3/projects/8b885fa4a4bf4fbf9ec3281398c7d2ce` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:03.447509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b885fa4a4bf4fbf9ec3281398c7d2ce)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:03.451595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:03.588798 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:03.592727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b885fa4a4bf4fbf9ec3281398c7d2ce', 'request_id': 'req-cada89c4-6d81-4f0c-988d-59e22d35529c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:03.598929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b885fa4a4bf4fbf9ec3281398c7d2ce', 'request_id': 'req-cada89c4-6d81-4f0c-988d-59e22d35529c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:03.703543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b885fa4a4bf4fbf9ec3281398c7d2ce', 'request_id': 'req-cada89c4-6d81-4f0c-988d-59e22d35529c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:03.716577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] The token cache is being invalidate because project 8b885fa4a4bf4fbf9ec3281398c7d2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:05:03.718439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:03.718439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cada89c4-6d81-4f0c-988d-59e22d35529c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:05:03.743879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1116/2230] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:05:03 2022] DELETE /identity/v3/projects/8b885fa4a4bf4fbf9ec3281398c7d2ce => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:05:09.438186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:09.438849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:09.438979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:09.440335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1115/2231] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:05:09.446395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad6df-b109-449d-998c-80fc7d41fe85 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:09.446933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad6df-b109-449d-998c-80fc7d41fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:09.447020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad6df-b109-449d-998c-80fc7d41fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:09.471392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-122ad6df-b109-449d-998c-80fc7d41fe85 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:09.472616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-122ad6df-b109-449d-998c-80fc7d41fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:09.541984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1117/2232] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:05:09.553578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:09.555381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:09.583308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:09.614440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07738086-93e6-416f-b565-dbc139a7bce8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:09.618195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:09.618871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:09.619151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:09.619955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:09.630619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:09.632037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959465af-2dbc-4f4d-92b6-6fc0377f3612 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:09.643236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1116/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:09.877295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad571-1788-4d39-b924-844b582c327a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:09.877587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad571-1788-4d39-b924-844b582c327a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:09.877865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fad571-1788-4d39-b924-844b582c327a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:09.879741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1118/2234] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:05:09.884537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acf22-cf78-4245-b48a-92c3dde43ae7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:09.884839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acf22-cf78-4245-b48a-92c3dde43ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:09.885104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acf22-cf78-4245-b48a-92c3dde43ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:09.905841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4b8acf22-cf78-4245-b48a-92c3dde43ae7 None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:09.907058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4b8acf22-cf78-4245-b48a-92c3dde43ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:09.959693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1117/2235] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:09.971594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fad571-1788-4d39-b924-844b582c327a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:09.973453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99fad571-1788-4d39-b924-844b582c327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:09.987660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fad571-1788-4d39-b924-844b582c327a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:09.991203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:10.000278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:10.000278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:10.000278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:10.000278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:10.001552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dfbeb-b3b7-4b87-9262-96893159179e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:10.020202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1119/2236] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:05:10.105212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff309c7-2a4d-4dd9-9821-c27055983591 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:10.105505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff309c7-2a4d-4dd9-9821-c27055983591 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:10.105779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff309c7-2a4d-4dd9-9821-c27055983591 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:10.107211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1118/2237] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:05:10.112901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01404-2f62-4017-90dd-eec6f34343f7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:10.113258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01404-2f62-4017-90dd-eec6f34343f7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:10.113569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01404-2f62-4017-90dd-eec6f34343f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:10.133605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c7c01404-2f62-4017-90dd-eec6f34343f7 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:10.134820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7c01404-2f62-4017-90dd-eec6f34343f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:10.143932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1120/2238] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:05:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:10.154681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff309c7-2a4d-4dd9-9821-c27055983591 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:10.165857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff309c7-2a4d-4dd9-9821-c27055983591 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:10.170014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:10.170631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:10.170913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:10.171185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:10.181281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:10.182739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772654a-5afb-44b7-99df-3400bb523e8c service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:10.193118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1119/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:12.196013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:12.196437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:12.196437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:12.217228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] MFA Rules not processed for user `cb3c865008c14e61829baefcd84f415a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:12.218448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:12.276792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1121/2240] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:17.173992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:17.174474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:17.174600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:17.194811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:17.196089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:17.270773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1120/2241] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:17.293876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:17.296201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:17.362640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:17.383881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90f645-6b59-4716-a9ae-128fe6bb534f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:17.388954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:17.393201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:17.393201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:17.393201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:17.398640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:17.400411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57b9d-4e7b-4298-ac8f-64cb4d34d267 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:17.408923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1122/2242] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:05:17.864528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:17.884111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775def7a-18c9-4d94-8bd3-d89e25cf4751 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:17.891467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:17.892574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:17.893104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:17.893611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:17.896272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:18.009516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:18.011924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:18.018979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:18.024282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1121/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:27.720653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=9 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:39.345019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:39.345600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:39.345600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:39.364144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:39.365329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:39.373389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1123/2244] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:05:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:39.386688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:39.399575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9e77e-5d82-4640-a3b2-a179ab69369d service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:39.404742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:39.406730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:39.406730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:39.406730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:39.414659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:39.416244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5611e-e42a-4108-a13b-2647d52c2c7c service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:39.425062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1122/2245] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:05:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:05:49.359558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:49.421898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:05:49.837223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:49.838742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:49.910164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89295b98-92df-4f68-ad7e-6a9519645463 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:49.915017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:49.915618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:49.915896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:49.916184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:49.917857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:49.929221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:49.930809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:49.940843 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1124/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:05:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:05:53.108207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7a2b2-dd47-4c86-ba63-36b52d2b4aee None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:53.108749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7a2b2-dd47-4c86-ba63-36b52d2b4aee None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:53.109079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7a2b2-dd47-4c86-ba63-36b52d2b4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:53.129338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-60c7a2b2-dd47-4c86-ba63-36b52d2b4aee None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:05:53.130573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-60c7a2b2-dd47-4c86-ba63-36b52d2b4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:05:53.137981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1123/2247] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:05:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:05:53.150970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:05:53.162322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a4c16-858e-4d89-b211-094e1009f8dc service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:05:53.167311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:05:53.167911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:05:53.168192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:05:53.168468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:05:53.177560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:05:53.179165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:05:53.188542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1125/2248] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:05:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:06:03.123182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:03.187589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=38 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:10.770242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984b49-1e11-40fa-8b58-f2ffefadd120 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:10.770811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984b49-1e11-40fa-8b58-f2ffefadd120 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:10.770964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984b49-1e11-40fa-8b58-f2ffefadd120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:10.789651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e4984b49-1e11-40fa-8b58-f2ffefadd120 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:06:10.790962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e4984b49-1e11-40fa-8b58-f2ffefadd120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:10.798295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1124/2249] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:06:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:06:10.812436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:10.823153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e4e5-086b-45a3-9713-fac1520e0ac7 service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:10.829210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:10.835224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:10.835224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:10.835224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:10.838584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:10.840141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0779e-e586-451d-ba92-dab72c2a1576 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:10.848301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1126/2250] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 12:06:13.550494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:13.551024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:13.551167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:13.552664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1125/2251] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:06:13.581559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:13.582042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:13.582151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:13.602621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] MFA Rules not processed for user `845278e5b9a74508acc333f09a2df68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:06:13.603840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:13.613253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1127/2252] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:06:13.624985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:13.627496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:13.644241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ecc6-9177-4d4d-a204-729717775e77 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:13.649245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:13.652229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:13.652229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:13.652229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:13.661152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:13.664734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:13.677764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1126/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:06:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:06:13.678865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:13.680411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:13.755454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1aa7b-c7e2-41fe-b8c4-ed1f054b58e0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:13.760187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:13.761336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:13.761336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:13.761336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] PATH_INFO: `/v3/users/cb3c865008c14e61829baefcd84f415a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:13.762460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3c865008c14e61829baefcd84f415a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:13.764416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:13.961817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3c865008c14e61829baefcd84f415a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.004299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3c865008c14e61829baefcd84f415a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.017789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3c865008c14e61829baefcd84f415a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.024880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3c865008c14e61829baefcd84f415a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.025760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c909bbe2-fa98-4760-a9df-bdf62fd1f3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3c865008c14e61829baefcd84f415a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.032355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1128/2254] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:06:13 2022] DELETE /identity/v3/users/cb3c865008c14e61829baefcd84f415a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:06:14.262614 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:06:14.274297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d1f5-ae0d-4106-afba-6ac515740c09 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:06:14.335287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:06:14.336081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:14.336414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:14.336708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] PATH_INFO: `/v3/projects/177a9d39d38c490aae2262074a174746` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:14.337894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=177a9d39d38c490aae2262074a174746)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:06:14.339960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:06:14.439885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177a9d39d38c490aae2262074a174746', 'request_id': 'req-70591388-648c-4c1d-b720-fcf72c12ea5e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.446306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177a9d39d38c490aae2262074a174746', 'request_id': 'req-70591388-648c-4c1d-b720-fcf72c12ea5e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.501053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177a9d39d38c490aae2262074a174746', 'request_id': 'req-70591388-648c-4c1d-b720-fcf72c12ea5e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.513706 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] The token cache is being invalidate because project 177a9d39d38c490aae2262074a174746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:06:14.513997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.514703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70591388-648c-4c1d-b720-fcf72c12ea5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:06:14.516201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1127/2255] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:06:14 2022] DELETE /identity/v3/projects/177a9d39d38c490aae2262074a174746 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:06:14.902978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751ada2-bc72-4d18-87db-f45705fa0c91 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:14.903436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751ada2-bc72-4d18-87db-f45705fa0c91 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:14.903663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751ada2-bc72-4d18-87db-f45705fa0c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:14.922721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f751ada2-bc72-4d18-87db-f45705fa0c91 None None] MFA Rules not processed for user `98f0fddb64e04ef39187cbd44fa8d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:06:14.923903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f751ada2-bc72-4d18-87db-f45705fa0c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:14.976228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1129/2256] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:06:24.509360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:24.969772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:31.029081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c2a9-63de-449f-ab5d-91fc3291f6fe None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:31.029709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c2a9-63de-449f-ab5d-91fc3291f6fe None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:31.029709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491c2a9-63de-449f-ab5d-91fc3291f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:31.048631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4491c2a9-63de-449f-ab5d-91fc3291f6fe None None] MFA Rules not processed for user `601eeaeae5024d48a762049ecbc3bd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:06:31.049448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4491c2a9-63de-449f-ab5d-91fc3291f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:31.107151 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1128/2257] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:06:41.100473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=25 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:06:45.342645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:06:45.347562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:06:45.347562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:06:45.362039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] MFA Rules not processed for user `5e642c2db91e45b38bf777c7a72a5380`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:06:45.363260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:06:45.416086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1130/2258] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:06:55.409697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=25 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:03.521780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:03.522266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:03.522403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:03.542024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:03.543247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:03.598308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1129/2259] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:03.620212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:03.621558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:03.690444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be85e17-c31a-4899-93f3-7b354ede8f3d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:03.695474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:03.696096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:03.696363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:03.696636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:03.704719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:03.706310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:03.715294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1131/2260] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:07:12.073139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:12.073139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:12.140778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d86aa-f80c-4468-a8dd-af9fb3eccb26 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:12.145306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:12.145932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:12.146210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:12.146483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] PATH_INFO: `/v3/users/9b53d11fc61b44c48054e62b7103ab7f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:12.147641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b53d11fc61b44c48054e62b7103ab7f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:12.149538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:12.313996 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b53d11fc61b44c48054e62b7103ab7f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.368267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b53d11fc61b44c48054e62b7103ab7f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.381018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b53d11fc61b44c48054e62b7103ab7f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.387746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b53d11fc61b44c48054e62b7103ab7f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.388375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b53d11fc61b44c48054e62b7103ab7f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.394817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1130/2261] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:12 2022] DELETE /identity/v3/users/9b53d11fc61b44c48054e62b7103ab7f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:12.620432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:12.631608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634caddd-f0fb-4a2f-b4eb-e7f0379d0518 service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:12.691728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:12.692347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:12.692627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:12.692902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] PATH_INFO: `/v3/projects/7162a397dc394625919493e14eabe780` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:12.694011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7162a397dc394625919493e14eabe780)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:12.695928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:12.808367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7162a397dc394625919493e14eabe780', 'request_id': 'req-63f1c470-80cf-4475-a6ab-8c911a5cc843'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.815012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7162a397dc394625919493e14eabe780', 'request_id': 'req-63f1c470-80cf-4475-a6ab-8c911a5cc843'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.882187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7162a397dc394625919493e14eabe780', 'request_id': 'req-63f1c470-80cf-4475-a6ab-8c911a5cc843'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.893123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] The token cache is being invalidate because project 7162a397dc394625919493e14eabe780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:12.893352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.893960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:12.895552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1132/2262] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:12 2022] DELETE /identity/v3/projects/7162a397dc394625919493e14eabe780 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:12.899520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:12.900914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:12.913752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39e858-3d42-46d1-b6ef-e53f7e657137 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:12.933402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:12.973012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:12.974842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:12.975126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:12.975402 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] PATH_INFO: `/v3/users/552485af3db547d59b7238468d549303` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:12.976554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=552485af3db547d59b7238468d549303)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:12.978450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:13.152464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552485af3db547d59b7238468d549303'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.242235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552485af3db547d59b7238468d549303'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.254150 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552485af3db547d59b7238468d549303'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.260843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552485af3db547d59b7238468d549303'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.261476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552485af3db547d59b7238468d549303'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.267851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1131/2263] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:12 2022] DELETE /identity/v3/users/552485af3db547d59b7238468d549303 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:13.524302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:13.525976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:13.540304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1c470-80cf-4475-a6ab-8c911a5cc843 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:13.557884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:13.597498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:13.598127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:13.598406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:13.598713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] PATH_INFO: `/v3/projects/672f26db04aa423d80d98f2b67cc03e2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:13.599820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] RBAC: Authorizing `identity:delete_project(project_id=672f26db04aa423d80d98f2b67cc03e2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:13.601702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:13.698550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672f26db04aa423d80d98f2b67cc03e2', 'request_id': 'req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.704652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672f26db04aa423d80d98f2b67cc03e2', 'request_id': 'req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.792242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672f26db04aa423d80d98f2b67cc03e2', 'request_id': 'req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.803792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] The token cache is being invalidate because project 672f26db04aa423d80d98f2b67cc03e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:13.804079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.804713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:13.806216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1133/2264] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:13 2022] DELETE /identity/v3/projects/672f26db04aa423d80d98f2b67cc03e2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:21.422702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:21.424117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:21.483438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d2e6-2cc7-4e18-8b11-5486f862f84f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:21.530434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:21.531058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:21.531333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:21.531598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:21.533330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:21.546081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:21.604161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:21.605586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:21.617353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1132/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:23.800507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:26.444034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:26.445479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:26.457943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad64a-6303-4b5b-b1ab-8619d41d135c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:26.461573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:26.462181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:26.462461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:26.462803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:26.464672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:26.479075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:26.480564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f82e8-23c7-4727-b5c7-ad026980684d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:26.492258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1134/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:31.659700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=27 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:36.487332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:37.329187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:37.330919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:37.363644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9cce-9a44-48b2-a37f-5c2b4fa5f0df service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:37.371607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:37.373083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:37.373370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:37.373643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:37.376132 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:37.472988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:37.474642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:37.484971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1133/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:39.277310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0cb1-0806-4766-80c7-d631835e1107 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:39.277794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0cb1-0806-4766-80c7-d631835e1107 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:39.277890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0cb1-0806-4766-80c7-d631835e1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:39.297680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b7fb0cb1-0806-4766-80c7-d631835e1107 None None] MFA Rules not processed for user `98f0fddb64e04ef39187cbd44fa8d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:39.298923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b7fb0cb1-0806-4766-80c7-d631835e1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:39.355162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1135/2268] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:07:40.332618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:40.334849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:40.410502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454f641-ddf2-4b96-8f83-c58d873c38df service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:40.415738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:40.416459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:40.416617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:40.416888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:40.418640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:40.431029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:40.432598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:40.443339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1134/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:40.857930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:40.858443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:40.858582 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:40.877187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] MFA Rules not processed for user `6b69918cb9a7405e8904af0291efefb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:40.878400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:40.931551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1136/2270] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:07:41.238765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:41.249333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804eb02-0acb-43bf-ba0c-ffe55f240d24 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:41.252928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:41.253533 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:41.253792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:41.254063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:41.255787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:41.265528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:41.266963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:41.274606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1135/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:42.752723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:42.766913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d947a-ea12-4758-a8c4-509a7b19ff85 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:42.773362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:42.774105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:42.774475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:42.774892 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:42.776801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:42.789010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:42.790817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:42.801160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1137/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:43.302488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:43.304464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:43.323075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df763683-02dc-4614-8007-4b3246973dfd service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:43.330481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:43.331395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:43.331679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:43.331974 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:43.337069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:43.406323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:43.407987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:43.417003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1136/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:45.549153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:45.550590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:45.562420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe226c1-c4a4-4d67-b5f9-8721177b77c1 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:45.566067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:45.566695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:45.566973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:45.567244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:45.568906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:45.649785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:45.651314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:45.662089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1138/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:49.754618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:49.756091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:49.769987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017d808-3ee3-44d0-b2f6-ea32a12e9bf1 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:49.774610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:49.775237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:49.775510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:49.775780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] PATH_INFO: `/v3/users/601eeaeae5024d48a762049ecbc3bd0a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:49.776891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601eeaeae5024d48a762049ecbc3bd0a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:49.779476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:49.785629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:49.940794 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601eeaeae5024d48a762049ecbc3bd0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:49.995675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601eeaeae5024d48a762049ecbc3bd0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.007605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601eeaeae5024d48a762049ecbc3bd0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.014915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601eeaeae5024d48a762049ecbc3bd0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.015559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601eeaeae5024d48a762049ecbc3bd0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.021306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1137/2275] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:49 2022] DELETE /identity/v3/users/601eeaeae5024d48a762049ecbc3bd0a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:50.170101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.172756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.174724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:50.180182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d2831-5fd6-44bd-83dc-d7b6401a9f19 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.211609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:50.233036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.233650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.233926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.234198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.235959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a01b-f587-45f4-bbf8-adab2f4dce31 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.236119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:50.239519 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.240116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.240392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.240663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.245926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.247329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:50.248125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.249655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ca6b3-a21d-4db9-b0d8-9ef99c160595 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:50.255241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1139/2276] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:50.258128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1138/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:50.289105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.290312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:50.391144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7a1b-8b58-48c2-a6a0-c984e7342895 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.398611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.400031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.400031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.400031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] PATH_INFO: `/v3/projects/103d85c375c0489dbef0497c3c41b686` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.402150 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=103d85c375c0489dbef0497c3c41b686)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.404663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:50.544542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103d85c375c0489dbef0497c3c41b686', 'request_id': 'req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.550614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103d85c375c0489dbef0497c3c41b686', 'request_id': 'req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.613347 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103d85c375c0489dbef0497c3c41b686', 'request_id': 'req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.625593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] The token cache is being invalidate because project 103d85c375c0489dbef0497c3c41b686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:50.625877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.626611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0df0acbb-d5c7-438d-a8d0-dc094ca89c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:50.628147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1140/2278] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:50 2022] DELETE /identity/v3/projects/103d85c375c0489dbef0497c3c41b686 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:50.633651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.633938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.634208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.654853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:50.656069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:50.715850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1139/2279] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:50.723818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.724181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.724530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.744747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:50.745957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:50.758442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1141/2280] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:50.759471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.770694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a80827-e6c2-4113-ab64-b0c5eb176bf1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.775311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.775908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.776189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.776461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.777110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:07:50.777416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.779063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:50.790692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1140/2281] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:07:50.795762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.805466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712a451-1e89-40e3-a21e-6bc4676437ef None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.810718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.811317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.811591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.812606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.812606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.814637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:50.885865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1142/2282] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:07:50 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:07:50.890071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:50.903091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949eddc-33e1-4ed5-a80c-c952423df2c4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:50.926337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:50.975282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:50.976009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:50.976284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:50.976558 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:50.977183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:50.979156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.054105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1141/2283] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:07:50 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:07:51.058122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.069901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110d40-b4bc-47fc-8e21-fb395c7de9ef admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.074804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.075445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.075728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.076014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.076666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.078252 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.088546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:51.093112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.103376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b1952-ebb4-40a8-960a-537b6edd5d42 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.108658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.109335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.109660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.109975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.110629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.112213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81399171-599e-4983-b718-a5e38e1127b4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.123234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1142/2285] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:51.127442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.137841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ee606-d48f-467f-b6e8-1543768c6c2c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.142561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.143255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.143534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.143807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] PATH_INFO: `/v3/projects/e1a526a7cea748688fa0abdae365716c/users/1257125bf6c84dc489872913fde9c89f/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.159785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a526a7cea748688fa0abdae365716c, user_id=1257125bf6c84dc489872913fde9c89f, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.162395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.237187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:51.242909 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1144/2286] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:51 2022] PUT /identity/v3/projects/e1a526a7cea748688fa0abdae365716c/users/1257125bf6c84dc489872913fde9c89f/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:07:51.253128 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.253547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.253774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.281385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] MFA Rules not processed for user `1257125bf6c84dc489872913fde9c89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:51.282655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:51.355647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1143/2287] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:51.360849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.422160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d0bd4-eda9-43a1-85c2-3c793e2ae2d6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.427247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.427985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.428277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.429050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.429224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.431283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.547361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1145/2288] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:07:51 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:07:51.551354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.563115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd20064-26fd-4cec-a567-27e46ea3a4cd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.627824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.630014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.630014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.630014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.630417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.632026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.750765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1144/2289] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:07:51 2022] POST /identity/v3/users => generated 308 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:07:51.758035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.769185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327214d-cd71-4c9c-9a5e-928566cfda23 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.773584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.774133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.774454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.774783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.778609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.778609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.792871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1146/2290] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:51.797280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.807578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243edca-c901-4d6f-81b0-befdce7481fc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.812837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.813653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.813992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.814271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] PATH_INFO: `/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520/users/cbbaef39c4854552bd1d7552985393ce/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.825682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:51.830502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6ff6eaca9e4c23a3ba7955475a7520, user_id=cbbaef39c4854552bd1d7552985393ce, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.833193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.895063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1145/2291] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:51 2022] PUT /identity/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520/users/cbbaef39c4854552bd1d7552985393ce/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:51.898675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:51.910541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19135f87-1e8b-4b44-8de2-0b7c865e539e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:51.979362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:51.980393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:51.980837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:51.981112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:51.982324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:51.984000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ab99a-0769-49e5-80f2-0200ba265431 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:51.995466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1147/2292] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:52.000537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:52.015140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb312a-27f7-48f6-9740-e39f300c84d4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:52.019687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:52.020359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:52.020635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:52.020905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] PATH_INFO: `/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520/users/cbbaef39c4854552bd1d7552985393ce/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:52.025277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6ff6eaca9e4c23a3ba7955475a7520, user_id=cbbaef39c4854552bd1d7552985393ce, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:52.027367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:52.041231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1146/2293] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:51 2022] PUT /identity/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520/users/cbbaef39c4854552bd1d7552985393ce/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:52.054971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:52.054971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:52.054971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:52.099769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] MFA Rules not processed for user `cbbaef39c4854552bd1d7552985393ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:52.101164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:52.208743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:52.221153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1148/2294] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:52.232014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:52.235073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:52.328070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c6e5d-ca58-4967-b168-5b8150bbd6db admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:52.332278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:52.332889 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:52.333233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:52.333503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:52.344376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:52.345354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e833c1c-23d8-46c4-8f73-30d249a465f2 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:52.356361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1147/2295] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:07:52.529017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:52.591331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f2122-d55e-4853-be7e-c24fe2c123dc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:52.596555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:52.597187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:52.597462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:52.597730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] PATH_INFO: `/v3/users/1257125bf6c84dc489872913fde9c89f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:52.598917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1257125bf6c84dc489872913fde9c89f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:52.600841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:52.793935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1257125bf6c84dc489872913fde9c89f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:52.859808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1257125bf6c84dc489872913fde9c89f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:52.873859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1257125bf6c84dc489872913fde9c89f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:52.881642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1257125bf6c84dc489872913fde9c89f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:52.882383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1257125bf6c84dc489872913fde9c89f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:52.888613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1149/2296] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:52 2022] DELETE /identity/v3/users/1257125bf6c84dc489872913fde9c89f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:07:52.893456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:52.893935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:52.894104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:52.913391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:52.914681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:52.987607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1148/2297] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:52.997460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:52.999554 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:53.060726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf031f6-6a00-45aa-a144-393e32fb5dd4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:53.064411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:53.065026 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:53.065304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:53.065579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:53.075310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:53.077280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:53.087693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1150/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:53.588998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:53.591127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:53.613028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786043c0-e19e-40ed-bc0f-1d569878009a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:53.617853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:53.618486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:53.618842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:53.619115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] PATH_INFO: `/v3/projects/e1a526a7cea748688fa0abdae365716c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:53.620242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a526a7cea748688fa0abdae365716c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:53.622276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:53.797378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a526a7cea748688fa0abdae365716c', 'request_id': 'req-603c2b03-67f5-4261-ba25-b787d5ff9c82'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:53.803871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a526a7cea748688fa0abdae365716c', 'request_id': 'req-603c2b03-67f5-4261-ba25-b787d5ff9c82'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:53.943782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a526a7cea748688fa0abdae365716c', 'request_id': 'req-603c2b03-67f5-4261-ba25-b787d5ff9c82'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:53.957060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] The token cache is being invalidate because project e1a526a7cea748688fa0abdae365716c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:53.957392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:53.958008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:53.959770 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1149/2299] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:53 2022] DELETE /identity/v3/projects/e1a526a7cea748688fa0abdae365716c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:53.963701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:53.978638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02bcd-9b3d-4e9a-a764-2cfcc9501b9c service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:53.991669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:54.054703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:54.055373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:54.055620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:54.055896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] PATH_INFO: `/v3/users/cbbaef39c4854552bd1d7552985393ce` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:54.057201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbaef39c4854552bd1d7552985393ce)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:54.059548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:54.320840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbaef39c4854552bd1d7552985393ce'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:54.436453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbaef39c4854552bd1d7552985393ce'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:54.451775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbaef39c4854552bd1d7552985393ce'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:54.458385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbaef39c4854552bd1d7552985393ce'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:54.459293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-67778368-1f13-4060-89ae-ef37b0d17d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbaef39c4854552bd1d7552985393ce'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:54.480604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1151/2300] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:53 2022] DELETE /identity/v3/users/cbbaef39c4854552bd1d7552985393ce => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:54.938576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:54.938576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:54.945662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:54.952768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2b03-67f5-4261-ba25-b787d5ff9c82 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.010107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.010763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.011036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.011307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] PATH_INFO: `/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.012422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6ff6eaca9e4c23a3ba7955475a7520)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.014922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.127103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6ff6eaca9e4c23a3ba7955475a7520', 'request_id': 'req-96707709-5e65-497d-860c-2575a35b6c27'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:55.134018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6ff6eaca9e4c23a3ba7955475a7520', 'request_id': 'req-96707709-5e65-497d-860c-2575a35b6c27'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:55.204199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6ff6eaca9e4c23a3ba7955475a7520', 'request_id': 'req-96707709-5e65-497d-860c-2575a35b6c27'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:55.217220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] The token cache is being invalidate because project 0f6ff6eaca9e4c23a3ba7955475a7520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:55.217610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:55.218380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-96707709-5e65-497d-860c-2575a35b6c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:55.220249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1150/2301] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:54 2022] DELETE /identity/v3/projects/0f6ff6eaca9e4c23a3ba7955475a7520 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:55.225173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.225647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.225767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.252713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:55.254166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:55.323210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1152/2302] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:55.331069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362789-758f-4476-bfe4-34b733e926cf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.331353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362789-758f-4476-bfe4-34b733e926cf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.331627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68362789-758f-4476-bfe4-34b733e926cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.351699 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-68362789-758f-4476-bfe4-34b733e926cf None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:55.353085 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-68362789-758f-4476-bfe4-34b733e926cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:55.361761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1151/2303] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:55.366096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.377759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85f956-18f3-4d55-96c4-7bbe2605092c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.382612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.383274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.383550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.383860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.384517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:07:55.384823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.387699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.401576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1153/2304] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:07:55.405996 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362789-758f-4476-bfe4-34b733e926cf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.415772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68362789-758f-4476-bfe4-34b733e926cf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.421174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.421785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.422066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.422344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.423015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.424919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.519473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1152/2305] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:07:55.524278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.536233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b24bd-7053-43fe-8761-4e9ff5218352 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.558896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:55.596688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.597299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.597608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.597878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.598510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.600422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.671069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1154/2306] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:07:55.679227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.689731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add5828-b12e-450f-b9f6-47c89aebea7e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.694359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.694987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.695266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.695544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.696194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.697835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.708005 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1153/2307] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:55.716384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.722350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55806c-a090-41e2-b0bc-cf738cdf62b6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.727168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.727775 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.728220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.728864 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.729632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.731250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb21ed0-f78d-401e-9d45-882bdae191f8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.742197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1155/2308] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:55.746163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:55.756139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0528-1247-499b-bdea-f5a4cbedc37f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:55.760796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:55.761457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.761735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.762183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] PATH_INFO: `/v3/projects/5803fe96676a45c1ab86e44f044340f8/users/45df281a86d94fffa5ec3aa865f8ef78/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.780173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5803fe96676a45c1ab86e44f044340f8, user_id=45df281a86d94fffa5ec3aa865f8ef78, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:55.782908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:55.871297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1154/2309] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:55 2022] PUT /identity/v3/projects/5803fe96676a45c1ab86e44f044340f8/users/45df281a86d94fffa5ec3aa865f8ef78/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:55.881855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:55.882179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:55.882456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:55.912719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] MFA Rules not processed for user `45df281a86d94fffa5ec3aa865f8ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:55.913978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:55.991803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1156/2310] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:55.996451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.031075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:56.061917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286faa69-dab3-4875-b27c-f9f1837649ae admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.066635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.067253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.067515 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.067787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.068413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.070307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.184302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1155/2311] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:07:55 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:07:56.185551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.196420 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d155-5b69-4ad1-95dd-682e1f943ed1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.252068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.252749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.252895 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.253181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.253796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.255770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.366736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1157/2312] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:07:56 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:07:56.370827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.382432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0aff6-4fd4-4769-acdd-4f83a08739d3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.387045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.387648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.387922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.388195 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.389594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.391218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.401893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1156/2313] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:56.406123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.416752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc855d-0243-483e-aacc-7a670110c7cf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.425755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.426705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.426996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.427268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] PATH_INFO: `/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0/users/7285ea5d3bbc4153b90a103e5d059356/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.443348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f580b0c4bd94a95bc3ceca47f25b9f0, user_id=7285ea5d3bbc4153b90a103e5d059356, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.445993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.540124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:56.545442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1158/2314] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:56 2022] PUT /identity/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0/users/7285ea5d3bbc4153b90a103e5d059356/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:56.549399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.559852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876300-c1b1-4ba2-8dab-b10ae840ca59 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.619032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.619927 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.620203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.620612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.621271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.623443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdc19-9347-4169-8b0c-a2e03eacfb4b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.638028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1157/2315] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:07:56.640631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.650694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecb9f-c412-4013-abee-b84c32893b11 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.655471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.656149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.656422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.656689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] PATH_INFO: `/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0/users/7285ea5d3bbc4153b90a103e5d059356/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.659037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f580b0c4bd94a95bc3ceca47f25b9f0, user_id=7285ea5d3bbc4153b90a103e5d059356, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.662110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.674092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1159/2316] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:07:56 2022] PUT /identity/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0/users/7285ea5d3bbc4153b90a103e5d059356/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:07:56.687159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.687805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.688179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.721452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] MFA Rules not processed for user `7285ea5d3bbc4153b90a103e5d059356`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:56.722884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:56.799175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1158/2317] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:07:56.811637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:56.813341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:56.874430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4ee0b-1c4c-4d7d-a035-724e0b524f58 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:56.878084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:56.878727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:56.879008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:56.879281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:56.888678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:56.890095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ea5ff-1fb7-4e67-aa55-48972ce0e7a3 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:56.899665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1160/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:07:57.979527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:58.007559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:58.043173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caf573-40d0-4842-9bc9-9b6734272f42 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:58.047848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:58.048478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:58.048756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:58.049025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] PATH_INFO: `/v3/users/45df281a86d94fffa5ec3aa865f8ef78` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:58.050162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45df281a86d94fffa5ec3aa865f8ef78)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:58.052378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:58.299938 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45df281a86d94fffa5ec3aa865f8ef78'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:58.377658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45df281a86d94fffa5ec3aa865f8ef78'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:58.393019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45df281a86d94fffa5ec3aa865f8ef78'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:58.401646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45df281a86d94fffa5ec3aa865f8ef78'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:58.401987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45df281a86d94fffa5ec3aa865f8ef78'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:58.413011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1159/2319] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:57 2022] DELETE /identity/v3/users/45df281a86d94fffa5ec3aa865f8ef78 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:07:58.414674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:58.415155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:58.415277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:58.436361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:07:58.437586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:58.536060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:58.536060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:58.546117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1161/2320] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:07:58.554968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:58.556650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:58.646492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445407b-7461-46fb-b1da-48c838a24396 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:58.653427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:58.654631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7fa3-60c5-4a58-80ab-1fe0e9d7f9b2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:58.654822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:58.655103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:58.655370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:58.657305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:58.658711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:58.659398 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:58.659748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:58.660091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:58.671928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:58.673457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:58.673744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:58.675686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:58.685687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1162/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:07:58.698399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1160/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:07:59.741635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:07:59.743229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:07:59.760425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8fe1e-8316-42ec-ac68-f729d41cc28a service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:07:59.766267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:07:59.767199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:07:59.767723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:07:59.768186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] PATH_INFO: `/v3/projects/5803fe96676a45c1ab86e44f044340f8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:07:59.770589 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5803fe96676a45c1ab86e44f044340f8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:07:59.773326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:07:59.878464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:07:59.899197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5803fe96676a45c1ab86e44f044340f8', 'request_id': 'req-7890618f-b299-4b28-8d12-deecfa96c47c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:59.906107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5803fe96676a45c1ab86e44f044340f8', 'request_id': 'req-7890618f-b299-4b28-8d12-deecfa96c47c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:59.973429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5803fe96676a45c1ab86e44f044340f8', 'request_id': 'req-7890618f-b299-4b28-8d12-deecfa96c47c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:59.991358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] The token cache is being invalidate because project 5803fe96676a45c1ab86e44f044340f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:07:59.991990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:59.992710 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:07:59.999702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1163/2323] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:07:59 2022] DELETE /identity/v3/projects/5803fe96676a45c1ab86e44f044340f8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:00.001605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:00.020058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcffbc0-60aa-4dac-a007-ae646ea89a72 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:00.050219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:00.083916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:00.084946 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:00.085379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:00.086050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] PATH_INFO: `/v3/users/7285ea5d3bbc4153b90a103e5d059356` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:00.087421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7285ea5d3bbc4153b90a103e5d059356)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:00.089641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:00.225609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7285ea5d3bbc4153b90a103e5d059356'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:00.298472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7285ea5d3bbc4153b90a103e5d059356'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:00.311695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7285ea5d3bbc4153b90a103e5d059356'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:00.318615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7285ea5d3bbc4153b90a103e5d059356'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:00.319323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6884eca3-8cf4-4816-b55b-1e67f494e1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7285ea5d3bbc4153b90a103e5d059356'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:00.325374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1161/2324] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:07:59 2022] DELETE /identity/v3/users/7285ea5d3bbc4153b90a103e5d059356 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:00.985556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:00.987795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:01.008908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890618f-b299-4b28-8d12-deecfa96c47c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:01.114166 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:01.114861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.117913 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.118220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] PATH_INFO: `/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.119529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f580b0c4bd94a95bc3ceca47f25b9f0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:01.121443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:01.252171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.252738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.252738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.261499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f580b0c4bd94a95bc3ceca47f25b9f0', 'request_id': 'req-bd819ef4-8373-4d4f-a698-391c5f477a98'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:01.272849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f580b0c4bd94a95bc3ceca47f25b9f0', 'request_id': 'req-bd819ef4-8373-4d4f-a698-391c5f477a98'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:01.286721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:01.289017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:01.371713 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f580b0c4bd94a95bc3ceca47f25b9f0', 'request_id': 'req-bd819ef4-8373-4d4f-a698-391c5f477a98'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:01.394214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] The token cache is being invalidate because project 4f580b0c4bd94a95bc3ceca47f25b9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:01.394545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:01.396148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd819ef4-8373-4d4f-a698-391c5f477a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:01.400876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1164/2325] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:00 2022] DELETE /identity/v3/projects/4f580b0c4bd94a95bc3ceca47f25b9f0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:01.405794 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de533f4-75ce-4242-aaa7-1798c0335fff None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.406185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de533f4-75ce-4242-aaa7-1798c0335fff None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.406584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de533f4-75ce-4242-aaa7-1798c0335fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.454568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1162/2326] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:01.462942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4de533f4-75ce-4242-aaa7-1798c0335fff None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:01.462942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4de533f4-75ce-4242-aaa7-1798c0335fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:01.477918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:01.479965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:01.532637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:01.550894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:01.558785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1165/2327] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:01.567331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.568089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.569194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.582989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d8c65-dbeb-4eb9-bed7-ca8493e33669 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:01.589712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:01.590329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.590635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.590910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.593678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:01.597259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:01.608073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:01.611312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:01.614268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1166/2328] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:08:01.618454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:01.622667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1163/2329] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:08:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:08:01.629433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0f22-1dca-4a58-a28a-b049f16f1633 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:01.635813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:01.636633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.637098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.637561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.638421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:08:01.639050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:01.640797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:01.658015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1167/2330] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:08:01.662662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:01.677341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684feea-dd9e-4be2-9111-fb08b9d68d87 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:01.683056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:01.683571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.683852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.684124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.684757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:01.686809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:01.774140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1164/2331] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:01 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:01.778116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:01.793338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae550cce-01d0-46ea-96cd-bb6022199614 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:01.884772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:01.888081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:01.888381 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:01.888657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:01.889301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:01.893225 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:01.969562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1168/2332] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:01 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:01.973976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:01.991785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3cd2-3970-41b4-acfc-9e83162fd2d2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.009626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.010536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.010890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.011231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.011958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.014157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.028340 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1165/2333] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:02.032922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.044040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60979-081e-42fd-bc16-876f0d69e58e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.049319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.049940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.050226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.050740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.051651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.053305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa6b21-afb1-4973-9d06-d4609eb9063c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.068298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1169/2334] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:02.070177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.081170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c43f3a-3858-4528-9e9e-869c1d51df7c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.090923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.092585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.092952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.093283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] PATH_INFO: `/v3/projects/80c087a6c61b48049eec3df45f200ec0/users/a78db9fe72144780939cfe7ffe1f3770/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.111737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c087a6c61b48049eec3df45f200ec0, user_id=a78db9fe72144780939cfe7ffe1f3770, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.114503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.210813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1166/2335] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:02 2022] PUT /identity/v3/projects/80c087a6c61b48049eec3df45f200ec0/users/a78db9fe72144780939cfe7ffe1f3770/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:02.223328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e8f09-e543-48af-b002-ea844c465eae None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.224263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e8f09-e543-48af-b002-ea844c465eae None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.224263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e8f09-e543-48af-b002-ea844c465eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.253646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-116e8f09-e543-48af-b002-ea844c465eae None None] MFA Rules not processed for user `a78db9fe72144780939cfe7ffe1f3770`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:02.255094 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-116e8f09-e543-48af-b002-ea844c465eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:02.374154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1170/2336] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:02.378257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.500589 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c5988-2876-4969-9f15-160bd8f9e2bb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.505424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.506039 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.506320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.506639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.507277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.509275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.605440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1167/2337] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:02 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:02.609859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e8f09-e543-48af-b002-ea844c465eae None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.623125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e8f09-e543-48af-b002-ea844c465eae None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.661604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:02.689470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.690183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.690551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.690884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.691523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.694324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.790588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1171/2338] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:02 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:02.793149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.806201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9b0c-1c3d-409e-bf7b-f0a54739889b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.812188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.813325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.813325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.813553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.814422 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.816144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.837133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.838232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1168/2339] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:08:02.850439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532a9e-e039-465a-a390-e6f5154710a7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.855290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.855904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.856183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.856457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.857672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.859297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00173-1bb1-4197-92d8-31846508b53d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.874556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1172/2340] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:08:02.877162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:02.888977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e058a39-0266-49de-8f70-b464841ff1be admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:02.893745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:02.894405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:02.894721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:02.894997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] PATH_INFO: `/v3/projects/3f50c93f94164ff199a19ccd356f52cc/users/2ef35ecb78ff4b169589c1a599303ee4/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:02.913241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f50c93f94164ff199a19ccd356f52cc, user_id=2ef35ecb78ff4b169589c1a599303ee4, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:02.916022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:02.997057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1169/2341] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:02 2022] PUT /identity/v3/projects/3f50c93f94164ff199a19ccd356f52cc/users/2ef35ecb78ff4b169589c1a599303ee4/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:03.009012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.009796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.010126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.053879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] MFA Rules not processed for user `2ef35ecb78ff4b169589c1a599303ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:03.055288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:03.154389 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1173/2342] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:03.155777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.225681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:03.243603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c240-e159-4618-a816-19b0c2208265 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.248623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.249225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.249499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.249767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.250384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.252311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.367829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1170/2343] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:03 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:03.370048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.382550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b90f7-9b35-4992-8f7a-8241222e921f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.460455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.461169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.461512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.461848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.463138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.465300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.552152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1174/2344] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:03 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:03.552299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.574116 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e83df4-f69f-4304-8b91-f2264039720d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.589002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.589625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.589899 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.590167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.590841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.592524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.616055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1171/2345] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:03.620004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.632134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aaf95-94a5-45a4-adb8-d098397b17e5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.643618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.644367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.644651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.644931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] PATH_INFO: `/v3/projects/0359d1fec19947149da78294a9f6e5e3/users/d0f7e6f58c2e40e296d339a599bbf47a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.686642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0359d1fec19947149da78294a9f6e5e3, user_id=d0f7e6f58c2e40e296d339a599bbf47a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.692020 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.772357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1175/2346] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:03 2022] PUT /identity/v3/projects/0359d1fec19947149da78294a9f6e5e3/users/d0f7e6f58c2e40e296d339a599bbf47a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:03.776724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.789033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c389bd-1cfc-4a54-b1c3-6dbaa881bef1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.879177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.879830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.880114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.880382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.881388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.883037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c30c-909f-4ff8-bcd3-501f30b3eeb5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.895836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1172/2347] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:03.900293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:03.912415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055724-e281-41c9-99c5-d9ce3041857e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:03.917670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:03.918336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.918643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.919054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] PATH_INFO: `/v3/projects/0359d1fec19947149da78294a9f6e5e3/users/d0f7e6f58c2e40e296d339a599bbf47a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.926349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0359d1fec19947149da78294a9f6e5e3, user_id=d0f7e6f58c2e40e296d339a599bbf47a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:03.929641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:03.932124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:03.941370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1176/2348] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:03 2022] PUT /identity/v3/projects/0359d1fec19947149da78294a9f6e5e3/users/d0f7e6f58c2e40e296d339a599bbf47a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:03.953099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:03.957529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:03.957529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:03.986918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] MFA Rules not processed for user `d0f7e6f58c2e40e296d339a599bbf47a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:03.988244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:04.088982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1173/2349] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:04.101748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:04.103657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:04.179809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11e5fd-abde-4af4-a1c7-fb5a26269706 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:04.183839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:04.184553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:04.184963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:04.185355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:04.195602 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:04.197985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:04.208930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1177/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:04.335735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:04.339210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:04.370063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8608-32e4-44e8-a147-bd93c5f7ed51 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:04.374021 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:04.375102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:04.375507 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:04.375881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:04.427399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:04.472236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:04.473607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a4ba6-a605-4980-9ec6-232c3e30a0f4 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:04.485397 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1174/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:08.956996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:09.033354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3693-4150-4404-9e11-a9cf4ca8ba94 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:09.040015 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:09.041654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:09.042379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:09.042912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] PATH_INFO: `/v3/users/a78db9fe72144780939cfe7ffe1f3770` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:09.045155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78db9fe72144780939cfe7ffe1f3770)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:09.049079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:09.274472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78db9fe72144780939cfe7ffe1f3770'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:09.350068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78db9fe72144780939cfe7ffe1f3770'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:09.364588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78db9fe72144780939cfe7ffe1f3770'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:09.373928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78db9fe72144780939cfe7ffe1f3770'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:09.377537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78db9fe72144780939cfe7ffe1f3770'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:09.384489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1178/2352] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:08:08 2022] DELETE /identity/v3/users/a78db9fe72144780939cfe7ffe1f3770 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:09.386275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:09.386843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:09.386843 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:09.408714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:09.409925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:09.492529 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1175/2353] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:09.503068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:09.504760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:09.525513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:09.583272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff58231-960e-4159-a1aa-ed084d971194 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:09.587514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:09.588384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:09.588779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:09.589053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:09.600935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:09.602603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:09.619277 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1179/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:10.159249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:10.160876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:10.174467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ca91c-e789-4094-ae07-4b1d78204746 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:10.179440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:10.180942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:10.180942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:10.181225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] PATH_INFO: `/v3/projects/80c087a6c61b48049eec3df45f200ec0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:10.182412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c087a6c61b48049eec3df45f200ec0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:10.184626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:10.278469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c087a6c61b48049eec3df45f200ec0', 'request_id': 'req-58da51fd-05c7-454d-bb66-2c022217fe5c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.286144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c087a6c61b48049eec3df45f200ec0', 'request_id': 'req-58da51fd-05c7-454d-bb66-2c022217fe5c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.344760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c087a6c61b48049eec3df45f200ec0', 'request_id': 'req-58da51fd-05c7-454d-bb66-2c022217fe5c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.358412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] The token cache is being invalidate because project 80c087a6c61b48049eec3df45f200ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:10.359114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.359705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.361282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1176/2355] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:10 2022] DELETE /identity/v3/projects/80c087a6c61b48049eec3df45f200ec0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:08:10.365480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:10.376044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876982a6-4b09-484c-9354-c9ffb6c9117b service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:10.448119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:10.448829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:10.449230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:10.453294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] PATH_INFO: `/v3/users/2ef35ecb78ff4b169589c1a599303ee4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:10.455604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef35ecb78ff4b169589c1a599303ee4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:10.457546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:10.654054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef35ecb78ff4b169589c1a599303ee4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.727752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef35ecb78ff4b169589c1a599303ee4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.744553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef35ecb78ff4b169589c1a599303ee4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.752542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef35ecb78ff4b169589c1a599303ee4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.753434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef35ecb78ff4b169589c1a599303ee4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:10.760003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1180/2356] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:08:10 2022] DELETE /identity/v3/users/2ef35ecb78ff4b169589c1a599303ee4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:11.364467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:11.366863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:11.382204 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da51fd-05c7-454d-bb66-2c022217fe5c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:11.438184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:11.446655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:11.447241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:11.447450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:11.447832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] PATH_INFO: `/v3/projects/3f50c93f94164ff199a19ccd356f52cc` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:11.449504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f50c93f94164ff199a19ccd356f52cc)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:11.458547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:11.899328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f50c93f94164ff199a19ccd356f52cc', 'request_id': 'req-09bda811-bae5-455e-89a4-93611799f75c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:11.906301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f50c93f94164ff199a19ccd356f52cc', 'request_id': 'req-09bda811-bae5-455e-89a4-93611799f75c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:11.982406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f50c93f94164ff199a19ccd356f52cc', 'request_id': 'req-09bda811-bae5-455e-89a4-93611799f75c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:11.993029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] The token cache is being invalidate because project 3f50c93f94164ff199a19ccd356f52cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:11.993310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:11.994024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:11.995552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1177/2357] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:11 2022] DELETE /identity/v3/projects/3f50c93f94164ff199a19ccd356f52cc => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:11.999743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:12.001154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:12.014973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2532d0-049f-4714-a611-388c3f8e6dd6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:12.057199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:12.086213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:12.087303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:12.087590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:12.087863 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] PATH_INFO: `/v3/users/d0f7e6f58c2e40e296d339a599bbf47a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:12.089073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f7e6f58c2e40e296d339a599bbf47a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:12.091073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:12.276838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f7e6f58c2e40e296d339a599bbf47a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:12.329170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f7e6f58c2e40e296d339a599bbf47a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:12.355791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f7e6f58c2e40e296d339a599bbf47a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:12.378861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f7e6f58c2e40e296d339a599bbf47a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:12.379617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f18cc8e9-7b62-4135-b49b-1148562e5744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f7e6f58c2e40e296d339a599bbf47a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:12.395879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1181/2358] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:08:11 2022] DELETE /identity/v3/users/d0f7e6f58c2e40e296d339a599bbf47a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:08:13.104048 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.105987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:13.120829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda811-bae5-455e-89a4-93611799f75c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.177570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.178206 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.178486 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.178865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] PATH_INFO: `/v3/projects/0359d1fec19947149da78294a9f6e5e3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.179990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0359d1fec19947149da78294a9f6e5e3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.181878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.321451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0359d1fec19947149da78294a9f6e5e3', 'request_id': 'req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:13.328164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0359d1fec19947149da78294a9f6e5e3', 'request_id': 'req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:13.395267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0359d1fec19947149da78294a9f6e5e3', 'request_id': 'req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:13.411000 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] The token cache is being invalidate because project 0359d1fec19947149da78294a9f6e5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:13.411288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:13.411935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2ac8e2c3-439c-43f7-aa4d-7d51c3bcd945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:13.413492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1178/2359] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:13 2022] DELETE /identity/v3/projects/0359d1fec19947149da78294a9f6e5e3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:13.420606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.421097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.421198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.442561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:13.443759 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:13.506959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1182/2360] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:13.516239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.516705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.516844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.539417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:13.540648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:13.549467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1179/2361] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:13.553978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.564117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca4e8d-a5f9-4b44-b803-42cff4112bc3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.568758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.569361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.569635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.569901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.570573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:08:13.570872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.572443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.585691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1183/2362] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:08:13.590177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.600269 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26fb66-d03e-4bd8-a551-06ff7bb428ad None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.604915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.605522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.605804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.606119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.607341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.609238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.613868 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:13.676916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1180/2363] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:13 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:13.684128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.694181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7a580-4d9e-48bb-b03d-6db70574e3af admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.736095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:13.750915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.751519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.751797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.752065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.752692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.754606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.827819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1184/2364] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:13 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:13.829063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.839410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ca659-b86b-4123-9663-540a54c4e897 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.844845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.845513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.845860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.846193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.846939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.848516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.859160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1181/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:13.863314 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.874085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954847f9-9e06-4aba-b6be-1b2f189347ea admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.879060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.880101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.880101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.880304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.880858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.882429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19389238-0469-45b1-8037-b1c2ec3fed0d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:13.893220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1185/2366] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:08:13.897354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:13.911873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed533ac0-6a1d-44f8-8a88-75df2f956c05 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:13.912663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:13.913308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:13.913581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:13.913856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] PATH_INFO: `/v3/projects/32c3a14bf5d04a38a07c6b44531a3603/users/b666335e6b3e481ab7f0af4b457a425a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:13.929711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c3a14bf5d04a38a07c6b44531a3603, user_id=b666335e6b3e481ab7f0af4b457a425a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:13.932625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:14.006823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1182/2367] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:13 2022] PUT /identity/v3/projects/32c3a14bf5d04a38a07c6b44531a3603/users/b666335e6b3e481ab7f0af4b457a425a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:14.018214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:14.018496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:14.018806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:14.046594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] MFA Rules not processed for user `b666335e6b3e481ab7f0af4b457a425a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:14.047836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:14.112344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1186/2368] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:14.123857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:14.125607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:14.183433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9716-5bde-4f58-843e-9440ed630007 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:14.187059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:14.188263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:14.188549 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:14.188820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:14.197265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:14.198909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a408e-9070-4ec4-b4b1-9339ec7b9aa2 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:14.208123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1183/2369] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:17.579099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:17.580659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:17.655600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933ed25-2de9-4e70-abed-0f96f840155f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:17.661402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:17.662027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:17.662307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:17.662668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:17.664440 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:17.678047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:17.679719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060102-ffcd-4438-964c-7bd59f268e03 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:17.690650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1187/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:19.369368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a5580-7e27-4437-9ec7-5cbad3be6658 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.369942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a5580-7e27-4437-9ec7-5cbad3be6658 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.370170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a5580-7e27-4437-9ec7-5cbad3be6658 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.371680 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1184/2371] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:08:19.377483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fede9-e8fb-42b4-aa2f-07bd80f4125e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.377922 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fede9-e8fb-42b4-aa2f-07bd80f4125e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.378180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fede9-e8fb-42b4-aa2f-07bd80f4125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.399527 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e37fede9-e8fb-42b4-aa2f-07bd80f4125e None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:19.400878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e37fede9-e8fb-42b4-aa2f-07bd80f4125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:19.415053 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1188/2372] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:19.427360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a5580-7e27-4437-9ec7-5cbad3be6658 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:19.437989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a5580-7e27-4437-9ec7-5cbad3be6658 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:19.443467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:19.444137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.444481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.444816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.460287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:19.461718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68ba8c-bb0c-445f-8f2f-52b75a4d788e service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:19.473576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1185/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:19.671952 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.672272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.672503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.673844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1189/2374] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:08:19.679221 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15f49-e9b2-45dd-be5b-713b22a30a6e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.679509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15f49-e9b2-45dd-be5b-713b22a30a6e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.679859 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d15f49-e9b2-45dd-be5b-713b22a30a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.699731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-88d15f49-e9b2-45dd-be5b-713b22a30a6e None None] MFA Rules not processed for user `4a8a0dbe3ac0405c876c1a07f500bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:19.700935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-88d15f49-e9b2-45dd-be5b-713b22a30a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:19.753628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1186/2375] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:19.765908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:19.767665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:19.780966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa5109-a323-4244-842a-6d921f331c85 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:19.784531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:19.785124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.785401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.785699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.792543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:19.793980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f238d7-cf30-40cc-a59f-ae84312245cf service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:19.801876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1190/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:19.890157 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.890445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.890744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.892091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1187/2377] 10.222.0.18 () {54 vars in 921 bytes} [Fri Aug 12 12:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 12:08:19.897470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374015d3-f67b-4ed9-987b-5db323ec2974 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.897760 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374015d3-f67b-4ed9-987b-5db323ec2974 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.898037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374015d3-f67b-4ed9-987b-5db323ec2974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.917514 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-374015d3-f67b-4ed9-987b-5db323ec2974 None None] MFA Rules not processed for user `6d46631580f04d5b8eb42424d520f83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:19.918748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-374015d3-f67b-4ed9-987b-5db323ec2974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:19.928777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1191/2378] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Aug 12 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:08:19.940236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:19.941971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:19.955580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270a431-0df3-4475-ae19-26ccdd0fd15d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:19.959140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:19.959760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:19.960035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:19.960309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:19.970820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:19.972371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:19.983404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1188/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:22.508725 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:22.509231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:22.509340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:22.534445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:22.537855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:22.554238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:22.606171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1192/2380] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:08:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:22.619103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:22.620662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:22.661758 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:22.691724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458d471-2e64-4cf9-8550-8fc441056dc0 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:22.697351 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:22.697959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:22.698284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:22.698582 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:22.707218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:22.708891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69c821-8be5-4d8c-961c-ffab4bea23b3 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:22.717156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1189/2381] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:08:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:08:32.623856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=20 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:32.669839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:32.720996 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=16 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:32.734495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea84c-a562-46fe-ad3e-b56ddda04a68 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:32.738960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:32.740348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:32.740348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:32.740348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] PATH_INFO: `/v3/users/b666335e6b3e481ab7f0af4b457a425a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:32.741201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b666335e6b3e481ab7f0af4b457a425a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:32.743132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:32.940033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b666335e6b3e481ab7f0af4b457a425a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.033413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b666335e6b3e481ab7f0af4b457a425a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.045804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b666335e6b3e481ab7f0af4b457a425a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.053599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b666335e6b3e481ab7f0af4b457a425a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.054244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b666335e6b3e481ab7f0af4b457a425a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.059978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1193/2382] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:08:32 2022] DELETE /identity/v3/users/b666335e6b3e481ab7f0af4b457a425a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:33.064714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:33.068448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:33.068448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:33.083602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:33.084851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:33.143408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1190/2383] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:33.153165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:33.154635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:33.210490 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa08e-b9b4-460f-a7a2-6fc7f48cb35b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:33.214146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:33.214789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:33.215069 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:33.215340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:33.224337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:33.225740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5016ee-bc56-4ab4-8f4e-c9c6e8d4537b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:33.235081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1194/2384] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:33.629199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:33.630835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:33.643330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac3c6a-3646-45b8-b299-c6cf5aa313d7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:33.647966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:33.648592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:33.648870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:33.649161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] PATH_INFO: `/v3/projects/32c3a14bf5d04a38a07c6b44531a3603` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:33.650274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c3a14bf5d04a38a07c6b44531a3603)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:33.652210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:33.762948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c3a14bf5d04a38a07c6b44531a3603', 'request_id': 'req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.770788 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c3a14bf5d04a38a07c6b44531a3603', 'request_id': 'req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.850951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c3a14bf5d04a38a07c6b44531a3603', 'request_id': 'req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.870214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] The token cache is being invalidate because project 32c3a14bf5d04a38a07c6b44531a3603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:33.870214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.870214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-408feda6-37c3-4caa-bdf7-a837cb7ec7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:33.870214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1191/2385] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:33 2022] DELETE /identity/v3/projects/32c3a14bf5d04a38a07c6b44531a3603 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:33.870615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:33.870615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:33.871142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:33.898349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:33.898349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:33.908882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:33.949558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1195/2386] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:33.958888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:33.959169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:33.959440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:33.978972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:33.980205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:33.988168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1192/2387] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:33.992268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.002192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d621f-d855-44dd-b958-d2a9c644c83e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.006842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.008937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.008937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.008937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.008937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:08:34.008937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.010569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.022594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1196/2388] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:08:34.026746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.035862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bebdc2-7155-4be5-9f29-5be896faf5c0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.040481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.041067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.041346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.041613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.042235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.044192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.129052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1193/2389] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:34 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:08:34.133287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.144168 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6554-c04f-4411-ae05-7e6f56145a1c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.203004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.203614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.203896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.204172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.204819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.206769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.294021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1197/2390] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:34 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:34.298626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.309370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee3ea-f0f0-4cc9-9f60-5b79f2f38b25 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.314682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.315331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.315606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.315894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.316537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.318163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.328123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1194/2391] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:08:34.332406 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.342414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655b123-ad7a-4ca4-b83e-0fae86f2164e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.347295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.347897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.348179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.348459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.349105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.350806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4c2e-2180-4d3a-a916-bf563781d88b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.362155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1198/2392] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:34.366418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.376933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45c557-861e-49bc-83f5-e445634a097d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.381545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.382192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.382471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.382790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] PATH_INFO: `/v3/projects/527e1b4d173244b9a73774468ee588a8/users/8acb397012d74f03bbf0a4626e328c7f/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.398175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=527e1b4d173244b9a73774468ee588a8, user_id=8acb397012d74f03bbf0a4626e328c7f, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.400916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.486691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1195/2393] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:34 2022] PUT /identity/v3/projects/527e1b4d173244b9a73774468ee588a8/users/8acb397012d74f03bbf0a4626e328c7f/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:34.497158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4c4a-0063-46e0-8b10-1014b0e4f37c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.497484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4c4a-0063-46e0-8b10-1014b0e4f37c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.497756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4c4a-0063-46e0-8b10-1014b0e4f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.526912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-780f4c4a-0063-46e0-8b10-1014b0e4f37c None None] MFA Rules not processed for user `8acb397012d74f03bbf0a4626e328c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:34.528126 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-780f4c4a-0063-46e0-8b10-1014b0e4f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:34.594433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1199/2394] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:34.604932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:34.606642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:34.628458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:34.664651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068fc0-4a33-4091-953e-a84c4ecfadbc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:34.668629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:34.669233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:34.669606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:34.669881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:34.678995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:34.680482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:34.690936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1196/2395] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:40.096717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea312-2506-4598-8d4d-331058720365 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:40.097161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea312-2506-4598-8d4d-331058720365 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:40.097264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea312-2506-4598-8d4d-331058720365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:40.115739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f1bea312-2506-4598-8d4d-331058720365 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:40.116930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f1bea312-2506-4598-8d4d-331058720365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:40.129195 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:40.177208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1200/2396] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:40.190216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:40.191625 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:40.259190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a773-ecbc-4e5e-9127-12204046bc91 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:40.264264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:40.264898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:40.265178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:40.265459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:40.273442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:40.275051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a1ec3-ac85-4807-9dd8-afd5fb6843ce service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:40.283026 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1197/2397] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 12:08:41.473104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea312-2506-4598-8d4d-331058720365 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:41.543219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea312-2506-4598-8d4d-331058720365 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:41.547921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:41.548540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:41.548817 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:41.549085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] PATH_INFO: `/v3/users/8acb397012d74f03bbf0a4626e328c7f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:41.550194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acb397012d74f03bbf0a4626e328c7f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:41.552395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:41.699516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acb397012d74f03bbf0a4626e328c7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:41.769917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acb397012d74f03bbf0a4626e328c7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:41.782124 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acb397012d74f03bbf0a4626e328c7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:41.789034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acb397012d74f03bbf0a4626e328c7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:41.789669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acb397012d74f03bbf0a4626e328c7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:41.795500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1201/2398] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:08:41 2022] DELETE /identity/v3/users/8acb397012d74f03bbf0a4626e328c7f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:41.800435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:41.800895 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:41.801007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:41.820180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:41.821367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:41.877765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1198/2399] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:41.887505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:41.888990 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:41.935617 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:41.952768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab0a3f-13ef-4035-9368-cc1fbbf19c05 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:41.952768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:41.952768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:41.952768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:41.953269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:41.961774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:41.963205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7641380-db11-4f3c-bb1f-2718d2cc9f0e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:41.973386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1202/2400] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:42.476816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:42.477981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:42.492617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be203-9dd0-4a86-b9ee-85ec2b466038 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:42.497562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:42.498203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:42.498481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:42.499624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] PATH_INFO: `/v3/projects/527e1b4d173244b9a73774468ee588a8` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:42.500581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527e1b4d173244b9a73774468ee588a8)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:42.502864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:42.634635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:42.636101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527e1b4d173244b9a73774468ee588a8', 'request_id': 'req-abb9ed82-44ab-484c-9ef8-4b0abc787162'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:42.642318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527e1b4d173244b9a73774468ee588a8', 'request_id': 'req-abb9ed82-44ab-484c-9ef8-4b0abc787162'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:42.741725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527e1b4d173244b9a73774468ee588a8', 'request_id': 'req-abb9ed82-44ab-484c-9ef8-4b0abc787162'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:42.753371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] The token cache is being invalidate because project 527e1b4d173244b9a73774468ee588a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:08:42.753654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:42.754268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-abb9ed82-44ab-484c-9ef8-4b0abc787162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:08:42.755773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1199/2401] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:08:42 2022] DELETE /identity/v3/projects/527e1b4d173244b9a73774468ee588a8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:08:42.760730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:42.761201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:42.761306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:42.780929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:42.782128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:42.839993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1203/2402] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:08:42.847789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:42.848315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:42.848469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:42.867442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:42.868619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:42.877648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1200/2403] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:42.881771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:42.891994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c3cb1-1fbe-459a-9d61-7de4bf667601 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:42.896499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:42.897092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:42.897365 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:42.897634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:42.898271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:08:42.898598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:42.900158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:42.911578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1204/2404] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:08:42.915808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:42.924853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4097d-e394-47f0-99f9-7fc5e23e3ccf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:42.929739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:42.930331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:42.930641 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:42.930914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:42.931536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:42.933425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.013753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1201/2405] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:08:42 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:43.018689 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:43.028761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8ff92-dda3-4ee4-baf6-f92b10781a09 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:43.085580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:43.086176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.086454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.086757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.087368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:43.089257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.148738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1205/2406] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:08:43 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:08:43.152811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:43.163176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcac4c-8b83-4fa9-8875-b1da83cd6c3b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:43.168041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:43.168630 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.168909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.169183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.169821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:43.172028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.182032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1202/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:43.185924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:43.196508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460027ab-0ec3-4edc-a359-319002ae1764 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:43.201019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:43.201599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.201902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.202173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.202847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:43.204404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13353918-a18a-4172-b55f-319a9f0867f9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.214531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1206/2408] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:08:43.218498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:43.228196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bf94-dcc0-48cb-b0ab-f3edd642236e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:43.232763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:43.233933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.234208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.234481 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] PATH_INFO: `/v3/projects/e62c6aceb6ee4313986667deee600c9c/users/9d7a0aeef047474894c4e16edfe1f5f4/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.250242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62c6aceb6ee4313986667deee600c9c, user_id=9d7a0aeef047474894c4e16edfe1f5f4, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:43.252911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.326679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1203/2409] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:08:43 2022] PUT /identity/v3/projects/e62c6aceb6ee4313986667deee600c9c/users/9d7a0aeef047474894c4e16edfe1f5f4/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:08:43.332346 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1969-458a-4d3b-bd3b-0d3480dddb9b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.332629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1969-458a-4d3b-bd3b-0d3480dddb9b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.332900 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1969-458a-4d3b-bd3b-0d3480dddb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.351741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-49ad1969-458a-4d3b-bd3b-0d3480dddb9b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:43.352925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-49ad1969-458a-4d3b-bd3b-0d3480dddb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:43.396366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:43.410245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1207/2410] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:43.419804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:43.422018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:43.477403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d534f-b38e-41eb-874a-37948781346f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:43.481053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:43.481649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:43.481923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:43.482198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:43.491398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:43.492806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:43.503179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1204/2411] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:44.731646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:44.732212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:44.732410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:44.762410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] MFA Rules not processed for user `9d7a0aeef047474894c4e16edfe1f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:44.763850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:44.829317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1208/2412] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:44.840718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:44.842097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:44.903441 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e824c3-adf9-41ec-827d-186c81d5cb68 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:44.907585 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:44.908188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:44.908471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:44.908741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:44.916872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:44.918297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7baeee-ca4f-4f2e-bf06-db2ae6fed7f1 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:44.927981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1205/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:45.968073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:45.977946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af149bb-e9cc-4ec7-a678-d448dc639346 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:45.981545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:45.982141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:45.982418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:45.982717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:45.984611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:46.045328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:46.046703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:46.055905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1209/2414] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:46.734538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:46.735087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:46.735087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:46.756093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] MFA Rules not processed for user `9d7a0aeef047474894c4e16edfe1f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:08:46.757631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:46.766189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1206/2415] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:08:47.008484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:08:47.009931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:47.021575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5c4f1-0ed0-4e4b-a09f-6b4b053f8a64 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:08:47.025107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:08:47.025716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:08:47.025994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:08:47.026266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:08:47.027946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:08:47.037064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:08:47.038471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:08:47.046766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1210/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:08:56.750236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:08:57.042865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=70 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:08.654124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:08.664394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2b38a-179d-4e07-a2b5-2d600d6c51b9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:08.668089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:08.668689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:08.668973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:08.669245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:08.671598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:08.683753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:08.685284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:08.695836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1207/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:10.641339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:10.651940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d58c-d98a-4c78-8a0a-e3a9ffbcf88e service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:10.656056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:10.656902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:10.657328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:10.657758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:10.659920 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:10.673638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:10.675865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:10.688911 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1211/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:12.325302 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:12.328695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:12.350818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48241-6b5a-4e73-9628-7334766d26b4 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:12.361459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:12.367292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:12.367292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:12.367292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] PATH_INFO: `/v3/users/98f0fddb64e04ef39187cbd44fa8d04a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:12.367292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f0fddb64e04ef39187cbd44fa8d04a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:12.367292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:12.569167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f0fddb64e04ef39187cbd44fa8d04a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:12.651134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f0fddb64e04ef39187cbd44fa8d04a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:12.665736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f0fddb64e04ef39187cbd44fa8d04a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:12.674792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f0fddb64e04ef39187cbd44fa8d04a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:12.675562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-32b1a046-b63e-432d-882d-23154b0d6aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f0fddb64e04ef39187cbd44fa8d04a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:12.682396 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1208/2419] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:12 2022] DELETE /identity/v3/users/98f0fddb64e04ef39187cbd44fa8d04a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:13.005427 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:13.016293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82e959-4d8c-428d-b841-b56b99bb62f9 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:13.090257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:13.091183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.091464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.091741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] PATH_INFO: `/v3/projects/b59a4a478759428badb325bea53b4dab` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.093450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59a4a478759428badb325bea53b4dab)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:13.095469 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:13.224202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59a4a478759428badb325bea53b4dab', 'request_id': 'req-abbf66c3-5dff-4686-b568-dd5a94a6264e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:13.230720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59a4a478759428badb325bea53b4dab', 'request_id': 'req-abbf66c3-5dff-4686-b568-dd5a94a6264e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:13.302942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59a4a478759428badb325bea53b4dab', 'request_id': 'req-abbf66c3-5dff-4686-b568-dd5a94a6264e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:13.316137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] The token cache is being invalidate because project b59a4a478759428badb325bea53b4dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:13.316519 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:13.317232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-abbf66c3-5dff-4686-b568-dd5a94a6264e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:13.322304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1212/2420] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:13 2022] DELETE /identity/v3/projects/b59a4a478759428badb325bea53b4dab => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:13.324866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.325197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.325539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.359601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:13.361083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:13.432992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1209/2421] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:13.441043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.445800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.445800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.461317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:13.462813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:13.472438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1213/2422] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:13.477391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:13.488094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf1ac8-36d9-4057-9127-95d253282deb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:13.492880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:13.493490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.493777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.494044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.494769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:13.495100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:13.496721 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:13.508435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1210/2423] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:13.512756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:13.523194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb3298-027d-452c-bb46-f82e83d9bb43 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:13.528581 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:13.529279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.529888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.530822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.535095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:13.535095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:13.641974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1214/2424] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:13 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:13.646811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:13.657768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b55c2-7cec-43de-8071-c14c2ef6ba2d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:13.764209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:13.782067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:13.782964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.783414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.785124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.785124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:13.786923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:13.919566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1211/2425] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:13 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:13.926043 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:13.941798 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a553-c894-4729-ba24-cf7b6365c0e4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:13.960732 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:13.961364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:13.961851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:13.962140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:13.962836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:13.967156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:13.992098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1215/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:13.996297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.008474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba82d1-78bd-4101-aa1c-6770f6b4d9f8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.014003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.015333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.015814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.016255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.017282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.019545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461f304-7089-4722-9d54-bb95eb4d3a85 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.046462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1212/2427] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:14.046708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.062310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3e72-238c-49d0-bbbd-4fef18e32737 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.071516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.072891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.073334 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.073845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] PATH_INFO: `/v3/projects/f7548025c76143318f89cda984f3a428/users/61fb5d482437468e88b8c58aca74d2a7/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.100825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7548025c76143318f89cda984f3a428, user_id=61fb5d482437468e88b8c58aca74d2a7, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.104543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.203447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1216/2428] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:14 2022] PUT /identity/v3/projects/f7548025c76143318f89cda984f3a428/users/61fb5d482437468e88b8c58aca74d2a7/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:14.207289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.207603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.207882 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.242152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] MFA Rules not processed for user `61fb5d482437468e88b8c58aca74d2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:14.243591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:14.323395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1213/2429] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:14.328532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.341696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:14.401149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd3cc-7dff-4104-a614-4b881226739b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.406615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.407574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.407574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.407908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.408678 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.410676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.519016 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1217/2430] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:14 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:14.520504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.532440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4842e00-03c4-4a29-ba9a-f003fb747b24 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.593853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.594470 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.594787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.595055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.595686 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.597591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.694959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1214/2431] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:14 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:14.699273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.709763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e036-215d-4120-8afc-7a4abd3cfd9e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.725839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.726702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.726970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.727258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.727914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.729502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.731609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.734076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:14.746946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1218/2432] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:14.749615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.751112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da58e-4bdb-433e-9bf6-2ac703a991c8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.755856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.756494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.756797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.757099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] PATH_INFO: `/v3/users/6b69918cb9a7405e8904af0291efefb9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.758301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b69918cb9a7405e8904af0291efefb9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.759814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525ad1-4aad-4a91-b262-5b937929fc18 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.760281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.764367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.765017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.765289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.765560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] PATH_INFO: `/v3/projects/37270e15a84e4691ba61a775bebb2d64/users/0c0b32d2e48a41d2bcf48907e44969ee/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.780691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37270e15a84e4691ba61a775bebb2d64, user_id=0c0b32d2e48a41d2bcf48907e44969ee, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.783616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.871283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1219/2433] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:14 2022] PUT /identity/v3/projects/37270e15a84e4691ba61a775bebb2d64/users/0c0b32d2e48a41d2bcf48907e44969ee/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:14.875654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.919660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:14.925807 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b69918cb9a7405e8904af0291efefb9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:14.937642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0263b-eb76-49e1-b696-a17995b25eb8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.942359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.942998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.943273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.943541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.944174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.945737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.956152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1220/2434] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:14.960151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:14.969362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc84a1-7da9-4a11-b366-a585f5992d62 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:14.973959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:14.974614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:14.974896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:14.975167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] PATH_INFO: `/v3/projects/37270e15a84e4691ba61a775bebb2d64/users/0c0b32d2e48a41d2bcf48907e44969ee/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:14.977019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37270e15a84e4691ba61a775bebb2d64, user_id=0c0b32d2e48a41d2bcf48907e44969ee, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:14.979615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365158b6-ec09-4f30-805e-061ce186f95c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:14.990547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1221/2435] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:14 2022] PUT /identity/v3/projects/37270e15a84e4691ba61a775bebb2d64/users/0c0b32d2e48a41d2bcf48907e44969ee/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:15.001190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b69918cb9a7405e8904af0291efefb9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.002996 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.003344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.004079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.014821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b69918cb9a7405e8904af0291efefb9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.024205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b69918cb9a7405e8904af0291efefb9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.025800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b69918cb9a7405e8904af0291efefb9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.032261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1215/2436] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:14 2022] DELETE /identity/v3/users/6b69918cb9a7405e8904af0291efefb9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:15.043147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] MFA Rules not processed for user `0c0b32d2e48a41d2bcf48907e44969ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:15.044407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.079019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:15.113266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1222/2437] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:15.125931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.127428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.187528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add766c-fec2-4550-9a95-6ce6b59c1864 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.191096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.191698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.192074 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.192390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.201693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.203755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:15.213139 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1216/2438] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:15.298653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.300569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.345308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.346737 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.357902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cab11-2e61-4ad8-b163-73b310b01804 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.362069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.362698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.362975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.363272 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.365082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.370884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd869-b6af-4d24-8a31-6a448e382307 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.372933 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.373493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.374399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.374715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] PATH_INFO: `/v3/projects/8042a8c3e31a415f91d0d5f227354554` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.375862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8042a8c3e31a415f91d0d5f227354554)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.377810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:15.425740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.427444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823584-564f-45ca-bf5f-0f18db62926b service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:15.436004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1217/2439] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:15.507313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8042a8c3e31a415f91d0d5f227354554', 'request_id': 'req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.513588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8042a8c3e31a415f91d0d5f227354554', 'request_id': 'req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.594193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8042a8c3e31a415f91d0d5f227354554', 'request_id': 'req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.605428 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] The token cache is being invalidate because project 8042a8c3e31a415f91d0d5f227354554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:15.605719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.606363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-087fc2a7-c546-4b7f-a176-058f2fc0ceeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:15.607994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1223/2440] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:15 2022] DELETE /identity/v3/projects/8042a8c3e31a415f91d0d5f227354554 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:15.613325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.613803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.613909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.633303 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:15.634429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.693695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:15.703309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1218/2441] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:15.716915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.717224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.718033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.739143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:15.740357 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:15.748438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1224/2442] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:15.752742 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.762962 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6bca4-9ee9-4d8f-bdfc-47fff8d04834 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.768196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.769109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.769109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.769380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.769953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:15.770253 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.771887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:15.783956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1219/2443] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:15.788296 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.797691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed776a9-1c6a-4c11-9cdf-d36e256800e5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.802781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.803374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.803653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.803925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.804576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.806441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:15.910100 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1225/2444] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:15 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:15.914051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:15.924434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfcea-34b8-439f-b277-30bad3739a22 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:15.978933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:15.979523 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:15.979800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:15.980068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:15.980690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:15.982612 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:16.106395 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1220/2445] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:15 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:16.106489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:16.113722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb80207-0b8c-40be-844f-14e0b8bde3a3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:16.120074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:16.120682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:16.120963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:16.121234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:16.121876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:16.123542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:16.137827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1226/2446] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:16.139122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:16.150010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea275-5d34-4d7a-b582-cc6d9873f93e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:16.154884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:16.155483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:16.155764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:16.156038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:16.156675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:16.158282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a6a03-875d-4dc1-a675-0e6f851fd5ad admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:16.175678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1221/2447] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:16.178871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:16.189770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d60d-9d32-4e71-a42a-ea2b23146c98 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:16.194820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:16.195520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:16.195797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:16.196073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] PATH_INFO: `/v3/projects/333f5c9b2a5c44e6a3155eda34d64b58/users/19814a52a9ea43f0ba93a5d2f6411cf6/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:16.212086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333f5c9b2a5c44e6a3155eda34d64b58, user_id=19814a52a9ea43f0ba93a5d2f6411cf6, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:16.214768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:16.295340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:16.304138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1227/2448] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:16 2022] PUT /identity/v3/projects/333f5c9b2a5c44e6a3155eda34d64b58/users/19814a52a9ea43f0ba93a5d2f6411cf6/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:16.315857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:16.316137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:16.316403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:16.346020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] MFA Rules not processed for user `19814a52a9ea43f0ba93a5d2f6411cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:16.347354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:16.411229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1222/2449] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:16.422677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:16.424338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:16.497518 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf62f3-8509-4635-9ced-ebe556227889 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:16.503541 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:16.509090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:16.509090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:16.509090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:16.512696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:16.514788 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf5ddd-5ff0-4057-be59-8d1633ce9ea3 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:16.523460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1228/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:19.753070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:19.807499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:19.819368 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c39f1-5251-4404-b321-dfc6144bc577 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:19.824017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:19.824640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:19.824919 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:19.825189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] PATH_INFO: `/v3/users/19814a52a9ea43f0ba93a5d2f6411cf6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:19.826336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19814a52a9ea43f0ba93a5d2f6411cf6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:19.828327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:20.056845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19814a52a9ea43f0ba93a5d2f6411cf6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:20.160495 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19814a52a9ea43f0ba93a5d2f6411cf6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:20.181228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19814a52a9ea43f0ba93a5d2f6411cf6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:20.190827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19814a52a9ea43f0ba93a5d2f6411cf6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:20.191591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19814a52a9ea43f0ba93a5d2f6411cf6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:20.198222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1223/2451] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:19 2022] DELETE /identity/v3/users/19814a52a9ea43f0ba93a5d2f6411cf6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:20.202742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:20.203222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:20.203416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:20.223593 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:20.225075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:20.290175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1229/2452] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:20.300616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:20.302427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:20.358750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e7e25-78e5-4eba-8f64-9d8137238b9c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:20.362963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:20.363564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:20.363884 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:20.364155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:20.373926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:20.375475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:20.386162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1224/2453] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:20.706330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:20.707806 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:20.720784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dadfd-78a7-4bd5-bfad-daac11d57d6a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:20.726245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:20.731363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:20.731643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:20.734595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] PATH_INFO: `/v3/users/61fb5d482437468e88b8c58aca74d2a7` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:20.734595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fb5d482437468e88b8c58aca74d2a7)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:20.735218 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:20.840197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:20.840197 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:20.852174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa913b3-575a-4312-a893-c8bcfcef6ca2 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:20.863291 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:20.863933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:20.864615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:20.874185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] PATH_INFO: `/v3/projects/333f5c9b2a5c44e6a3155eda34d64b58` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:20.874185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333f5c9b2a5c44e6a3155eda34d64b58)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:20.874185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:20.927536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fb5d482437468e88b8c58aca74d2a7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.027061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333f5c9b2a5c44e6a3155eda34d64b58', 'request_id': 'req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.033954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fb5d482437468e88b8c58aca74d2a7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.037747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333f5c9b2a5c44e6a3155eda34d64b58', 'request_id': 'req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.055726 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fb5d482437468e88b8c58aca74d2a7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.063098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:21.065739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fb5d482437468e88b8c58aca74d2a7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.066462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cb701f79-a6c0-4985-a8eb-dcf06a662f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fb5d482437468e88b8c58aca74d2a7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.072384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1230/2454] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:20 2022] DELETE /identity/v3/users/61fb5d482437468e88b8c58aca74d2a7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:21.076679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.076963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.077250 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.097769 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:21.099049 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.117079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333f5c9b2a5c44e6a3155eda34d64b58', 'request_id': 'req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.125391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:21.130167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] The token cache is being invalidate because project 333f5c9b2a5c44e6a3155eda34d64b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:21.130456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.131226 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-088cf4d9-08e6-4d9b-b882-9f01841dd1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.136462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1225/2455] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:20 2022] DELETE /identity/v3/projects/333f5c9b2a5c44e6a3155eda34d64b58 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:21.137792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fa8c-5ad3-4624-8f90-45794e064e13 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.138078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fa8c-5ad3-4624-8f90-45794e064e13 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.138354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fa8c-5ad3-4624-8f90-45794e064e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.164951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bf85fa8c-5ad3-4624-8f90-45794e064e13 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:21.166314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bf85fa8c-5ad3-4624-8f90-45794e064e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.168283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1231/2456] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:21.175848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1226/2457] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:21.178547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.181577 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.184798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.185246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.185687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.209114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:21.210325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.226659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1227/2458] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:21.227377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.237292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2345d-e3d2-4b84-b30b-5fe6b85ff20b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.242189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.242848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.243130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.243435 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.243879 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe982b24-4501-41de-814e-fece7a7f2188 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.244738 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:21.245055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.246808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.247715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.248370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.248650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.248917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.262611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1228/2459] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:09:21.262778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.262778 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.263512 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.271144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1232/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:21.273367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e4d62-dd9d-48e6-8d40-9a61a64e9cfe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.279042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.279042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.279042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.279357 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.279920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.281805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7b338-22cc-4c80-bade-740d00afeaa8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.373461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1229/2461] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:21.374777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.384873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38d01-fcc6-45ae-8238-0c19d58691df service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.442231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.442857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.443137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.443412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.444027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.445924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.466149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.466447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.466719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.496573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:21.497797 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.506834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1230/2462] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:21.530850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.532183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.568644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1233/2463] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/users => generated 282 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:21.569789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.581621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99ce0-9d78-4094-93c3-eda0a9c8b433 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.715528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.715528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.715528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.715528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.717565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.717565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.717565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1234/2464] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:21.717565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.717565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a51c-2f6a-47e3-b05d-81d171d967b9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.718110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.718110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.718110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.718110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.718473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.718473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.718736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad9948-a629-4bc5-9c77-5b3ddb3476ee None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.718736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.718736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.718736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.719127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.719243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1235/2465] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:21.719243 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.719429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.719429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.719618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e38ca-49a3-42f7-ab11-15fe29a39041 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.719762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1231/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:21.719887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.719887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.719887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.719887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] PATH_INFO: `/v3/projects/1159988dbfd34c1cb915e2c45e46823f/users/a8a3369b63fb4b8ea548b84ba649fc34/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.720935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:21.720935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1159988dbfd34c1cb915e2c45e46823f, user_id=a8a3369b63fb4b8ea548b84ba649fc34, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.720935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f6143-70df-4dd7-a5d2-e37b947eb833 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.788867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.788867 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.800787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf58bc-84ae-4a5f-8f3e-a111b91392b2 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.805602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:21.806239 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.806534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.806831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] PATH_INFO: `/v3/projects/f7548025c76143318f89cda984f3a428` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.807961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7548025c76143318f89cda984f3a428)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:21.810101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:21.818109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1236/2467] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:21 2022] PUT /identity/v3/projects/1159988dbfd34c1cb915e2c45e46823f/users/a8a3369b63fb4b8ea548b84ba649fc34/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:21.826391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:21.826669 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:21.826971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:21.854394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] MFA Rules not processed for user `a8a3369b63fb4b8ea548b84ba649fc34`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:21.855637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:21.918649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1237/2468] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:21.923505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:21.927213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7548025c76143318f89cda984f3a428', 'request_id': 'req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.933417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7548025c76143318f89cda984f3a428', 'request_id': 'req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.982033 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7548025c76143318f89cda984f3a428', 'request_id': 'req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.985790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a1930-d5a5-4813-bc48-082f5f163e37 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:21.993590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] The token cache is being invalidate because project f7548025c76143318f89cda984f3a428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:21.993853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.994618 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:21.996439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1232/2469] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:21 2022] DELETE /identity/v3/projects/f7548025c76143318f89cda984f3a428 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:22.000518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.001885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.014772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:22.042609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.043297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.043463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.043764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.044612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.046275 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.066564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b145ff-3b0c-4de9-b96e-6a9a30df3b07 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.071175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.071806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.072083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.072364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] PATH_INFO: `/v3/users/0c0b32d2e48a41d2bcf48907e44969ee` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.073789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0b32d2e48a41d2bcf48907e44969ee)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.075863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.152734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1238/2470] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:21 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:22.156805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.160550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.164388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:22.221394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bb75b-35dd-41fb-8eca-ca2fca8a4e45 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.226002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.226632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.226908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.227178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.227790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.229662 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.304299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0b32d2e48a41d2bcf48907e44969ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:22.348298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1239/2471] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:22 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:22.352619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.364931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dd0bd-6db9-496c-bba0-60eedbf484e1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.369847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.370638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.370997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.371382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.372044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0b32d2e48a41d2bcf48907e44969ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:22.372181 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.373949 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.385384 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1240/2472] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:22.393503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0b32d2e48a41d2bcf48907e44969ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:22.397975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.400745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0b32d2e48a41d2bcf48907e44969ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:22.401496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0b32d2e48a41d2bcf48907e44969ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:22.420193 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1233/2473] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:21 2022] DELETE /identity/v3/users/0c0b32d2e48a41d2bcf48907e44969ee => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:22.427080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52929-42a8-4e39-92d8-a79e058c1d4f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.492810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.493483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.493766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.494044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] PATH_INFO: `/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3/users/46d01024d82d4eec9efac0b98cf1cc62/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.509623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89c558f21c4fb9bd60dc18c1192ca3, user_id=46d01024d82d4eec9efac0b98cf1cc62, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.512304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.604114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1241/2474] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:22 2022] PUT /identity/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3/users/46d01024d82d4eec9efac0b98cf1cc62/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:22.608170 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.609768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.623353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617957b-740b-4831-8e3a-f8fab95ae899 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.684754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.685364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.685639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.685913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.686654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.688199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9ed6-5406-402a-aec7-51fb65a461b3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.701169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1234/2475] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:22.702550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.713303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58eeb-e29c-4da0-8a20-7b1d01589ac1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.717984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.718675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.718966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.719212 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] PATH_INFO: `/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3/users/46d01024d82d4eec9efac0b98cf1cc62/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.721178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c89c558f21c4fb9bd60dc18c1192ca3, user_id=46d01024d82d4eec9efac0b98cf1cc62, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.723828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.734564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1242/2476] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:22 2022] PUT /identity/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3/users/46d01024d82d4eec9efac0b98cf1cc62/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:22.746863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.747392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.747522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.775556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] MFA Rules not processed for user `46d01024d82d4eec9efac0b98cf1cc62`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:22.776864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.789359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:22.842834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1235/2477] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:22.855045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.856748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.874013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:22.875755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:22.925557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28bb83-2cc9-470b-a504-e0139b4c3282 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.929563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.930233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.930626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.930964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.939325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:22.942135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.943666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f82f84-7366-4fc2-89e6-8c906713788a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:22.953312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1243/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:22.955717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0dea-e95e-48c3-a8b9-9f7a4e04ca09 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:22.960779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:22.961409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:22.961687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:22.961956 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] PATH_INFO: `/v3/projects/37270e15a84e4691ba61a775bebb2d64` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:22.963106 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37270e15a84e4691ba61a775bebb2d64)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:22.968944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.119634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37270e15a84e4691ba61a775bebb2d64', 'request_id': 'req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:23.125660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37270e15a84e4691ba61a775bebb2d64', 'request_id': 'req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:23.216374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37270e15a84e4691ba61a775bebb2d64', 'request_id': 'req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:23.229006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] The token cache is being invalidate because project 37270e15a84e4691ba61a775bebb2d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:23.229287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:23.230275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:23.231852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1236/2479] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:22 2022] DELETE /identity/v3/projects/37270e15a84e4691ba61a775bebb2d64 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:23.236599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca07fd-0fd6-493b-b18c-7f3ac7438fdc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.236929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca07fd-0fd6-493b-b18c-7f3ac7438fdc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.237247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca07fd-0fd6-493b-b18c-7f3ac7438fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.237367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.238769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:23.256251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5eca07fd-0fd6-493b-b18c-7f3ac7438fdc None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:23.257462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5eca07fd-0fd6-493b-b18c-7f3ac7438fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:23.307633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1344c-c52b-4f1e-a8e6-30bfc71b417e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.315145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.315761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.316042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.316313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.318158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:23.337011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:23.346035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.346035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.346035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.367772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:23.369005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:23.378419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1245/2481] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:23.382594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.384423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.386002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.391961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191794-21da-4de7-b4bc-583c7d28b621 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.395263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1237/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:23.398813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.402827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.418255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1246/2483] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:09:23.419371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.432335 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c284a7-fbd7-485e-8de1-e47b45f494ca service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.437284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.437948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.438235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.438656 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.439769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.441722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.581662 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1238/2484] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:23 2022] POST /identity/v3/projects => generated 407 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:23.582878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.598957 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedb150-4f35-4bde-8635-90d06323b9df admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.654187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.654779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.655110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.660537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.660537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.661621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:23.661805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.772377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1247/2485] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:23 2022] POST /identity/v3/users => generated 304 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:23.776805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.787101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cf66c-b501-435b-8f25-4997618554aa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.791691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.792349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.792605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.792871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.793521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.795203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.809841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1239/2486] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:23.816354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.830918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e866f7d-062b-4d74-85e5-0c0a9ec5c815 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.837548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.838552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.838916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.839184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.839973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.841849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9de581-6fbe-4b04-ac6f-4fdfca08cf5e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.859177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1248/2487] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:23.864711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:23.877146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7289a-5c21-4e4c-b408-aa8331b3e6d9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:23.884837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:23.885504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.885778 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.886049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] PATH_INFO: `/v3/projects/6f9f687b6bdc49d09e8620295a2bb2e8/users/e9a03f8c20044a07a229c860773f6ac9/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:23.904688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9f687b6bdc49d09e8620295a2bb2e8, user_id=e9a03f8c20044a07a229c860773f6ac9, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:23.907832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:23.983038 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1240/2488] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:23 2022] PUT /identity/v3/projects/6f9f687b6bdc49d09e8620295a2bb2e8/users/e9a03f8c20044a07a229c860773f6ac9/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:23.997030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:23.997397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:23.997740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.033301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] MFA Rules not processed for user `e9a03f8c20044a07a229c860773f6ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:24.033684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:24.083374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:24.105162 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1249/2489] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:24.109597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.171775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bce2-9caf-4291-8177-c9c967901d59 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.177188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.177793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.178065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.178452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.179111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.181007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.287371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1241/2490] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:24 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:24.289558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.301614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350697f-18cc-4830-bdc5-6950e5cd3291 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.357956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.358594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.358878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.359422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.360047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.362715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.492865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1250/2491] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:24 2022] POST /identity/v3/users => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:24.493888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.493888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a4f5e-a023-41d7-a2a3-a117625bd68f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.498304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.498989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.499264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.499535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.500174 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.502365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.513709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1242/2492] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:24.518585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.529303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b9716-7f4b-47a0-93b9-565bf16adb86 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.534387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.535068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.535341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.535609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] PATH_INFO: `/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b/users/fa0ce917bbc04bac9d91c6094de56c2a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.551814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daad1d0395d94deeb1d92e83bfb45b2b, user_id=fa0ce917bbc04bac9d91c6094de56c2a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.554766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.675155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1251/2493] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:24 2022] PUT /identity/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b/users/fa0ce917bbc04bac9d91c6094de56c2a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:24.679255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.694032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01fddb-912c-4fc1-93a2-4d53e2eed193 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.709931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:24.783905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.784527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.784804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.785079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.785734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.787374 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5026bd-d0b4-43ac-9af9-0364be12f03b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.800494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1243/2494] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:24.806253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:24.827474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f800-870c-4a9e-867b-9ea2511ca8a3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:24.834163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:24.834877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.838727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.838727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] PATH_INFO: `/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b/users/fa0ce917bbc04bac9d91c6094de56c2a/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.838727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=daad1d0395d94deeb1d92e83bfb45b2b, user_id=fa0ce917bbc04bac9d91c6094de56c2a, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:24.840419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:24.858687 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1252/2495] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:24 2022] PUT /identity/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b/users/fa0ce917bbc04bac9d91c6094de56c2a/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:24.870266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:24.870606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:24.870902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:24.905910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] MFA Rules not processed for user `fa0ce917bbc04bac9d91c6094de56c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:24.908663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:25.020023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1244/2496] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:25.030872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:25.102002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f582e48-575b-4c7e-bd53-4c407f82b4db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:25.111369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:25.111369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:25.111369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:25.111369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:25.119377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:25.121339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c51c9-82ba-4079-b710-49f4f3589cff service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:25.134945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1253/2497] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:25.734044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:25.744350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99a0c2-87c2-4321-9f1c-b4607b42b485 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:25.748304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:25.748983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:25.749327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:25.749694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:25.836199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:25.837757 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:25.847717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1245/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:25 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:26.928899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:26.929422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:26.929422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:26.951052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:26.952171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:26.990350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:27.016491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1254/2499] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:27.038208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:27.039692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:27.075462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:27.105799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:27.105799 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:27.115089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de55b5-6c16-4213-9473-dfe0e7130bb6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:27.115932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3eef4-484d-481e-b41c-9f5979fef661 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:27.119860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:27.120480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:27.120762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:27.121033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] PATH_INFO: `/v3/users/a8a3369b63fb4b8ea548b84ba649fc34` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:27.121273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:27.121872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:27.122146 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:27.122247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a3369b63fb4b8ea548b84ba649fc34)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:27.122414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:27.124103 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:27.131155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:27.132784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8def-9917-40b3-9dd6-88b2a6276801 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:27.143114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1246/2500] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:27.310974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a3369b63fb4b8ea548b84ba649fc34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:27.370505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a3369b63fb4b8ea548b84ba649fc34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:27.383104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a3369b63fb4b8ea548b84ba649fc34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:27.389805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a3369b63fb4b8ea548b84ba649fc34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:27.390463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a3369b63fb4b8ea548b84ba649fc34'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:27.396475 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1255/2501] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:27 2022] DELETE /identity/v3/users/a8a3369b63fb4b8ea548b84ba649fc34 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:27.400907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:27.401186 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:27.402822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:27.546075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:27.547324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:27.605768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1247/2502] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:27.615702 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:27.617238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:27.674733 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb144-87aa-4b94-a413-45f049f3e16f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:27.678688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:27.679298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:27.679570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:27.679894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:27.689409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:27.693468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:27.701064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1256/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:28.144383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:28.145844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:28.159652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb503-2c7c-44e4-bc29-1a671a327675 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:28.164577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:28.169310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:28.169310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:28.169310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] PATH_INFO: `/v3/projects/1159988dbfd34c1cb915e2c45e46823f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:28.169310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1159988dbfd34c1cb915e2c45e46823f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:28.169310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:28.270524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1159988dbfd34c1cb915e2c45e46823f', 'request_id': 'req-9491aa67-695b-4588-8a8c-4cb6acedd722'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.276584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1159988dbfd34c1cb915e2c45e46823f', 'request_id': 'req-9491aa67-695b-4588-8a8c-4cb6acedd722'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.350970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1159988dbfd34c1cb915e2c45e46823f', 'request_id': 'req-9491aa67-695b-4588-8a8c-4cb6acedd722'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.364745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] The token cache is being invalidate because project 1159988dbfd34c1cb915e2c45e46823f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:28.365296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.366207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.371745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1248/2504] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:28 2022] DELETE /identity/v3/projects/1159988dbfd34c1cb915e2c45e46823f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:28.373449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:28.390776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe04cce-5a65-49ed-992c-c272434bb4c1 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:28.442201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:28.448822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:28.449448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:28.449730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:28.450007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] PATH_INFO: `/v3/users/46d01024d82d4eec9efac0b98cf1cc62` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:28.451176 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d01024d82d4eec9efac0b98cf1cc62)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:28.453111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:28.652329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d01024d82d4eec9efac0b98cf1cc62'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.765327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d01024d82d4eec9efac0b98cf1cc62'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.780443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d01024d82d4eec9efac0b98cf1cc62'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.789877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d01024d82d4eec9efac0b98cf1cc62'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.790676 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-db49c553-9f1b-4ced-ae6e-4268e42e96e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d01024d82d4eec9efac0b98cf1cc62'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:28.796629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1257/2505] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:28 2022] DELETE /identity/v3/users/46d01024d82d4eec9efac0b98cf1cc62 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:29.221813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:29.224607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:29.235998 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491aa67-695b-4588-8a8c-4cb6acedd722 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:29.277273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:29.293888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:29.294508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.294827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.295103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] PATH_INFO: `/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.296214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c89c558f21c4fb9bd60dc18c1192ca3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:29.298094 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:29.405595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c89c558f21c4fb9bd60dc18c1192ca3', 'request_id': 'req-e59d085f-556c-47d9-8a0d-805e210d7ed9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:29.412664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c89c558f21c4fb9bd60dc18c1192ca3', 'request_id': 'req-e59d085f-556c-47d9-8a0d-805e210d7ed9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:29.475844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c89c558f21c4fb9bd60dc18c1192ca3', 'request_id': 'req-e59d085f-556c-47d9-8a0d-805e210d7ed9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:29.493001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] The token cache is being invalidate because project 3c89c558f21c4fb9bd60dc18c1192ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:29.493297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:29.493948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:29.495464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1249/2506] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:29 2022] DELETE /identity/v3/projects/3c89c558f21c4fb9bd60dc18c1192ca3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:29.504959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2269957-9caa-4f1d-b7a5-8bd326062e8a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.505462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2269957-9caa-4f1d-b7a5-8bd326062e8a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.505551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2269957-9caa-4f1d-b7a5-8bd326062e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.528944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c2269957-9caa-4f1d-b7a5-8bd326062e8a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:29.528944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c2269957-9caa-4f1d-b7a5-8bd326062e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:29.537342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:29.552709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:29.599298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d085f-556c-47d9-8a0d-805e210d7ed9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:29.601625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1258/2507] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:29.603629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:29.604229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.604510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.604768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.606709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:29.609278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.609451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.609873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.623007 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:29.624570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:29.630874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:29.632090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:29.634878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1250/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:29.647633 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1259/2509] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:29.651621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:29.662092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ae35-1a3e-40a4-898f-6e3206ae04af service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:29.666494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:29.667142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.667419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.667690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.668338 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:29.668636 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:29.670203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:29.683384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1251/2510] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:09:29.688555 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:29.698259 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dbf81-fd3b-420d-b652-d2aa6e916eca None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:29.703586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:29.704348 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.704684 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.705011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.705650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:29.707579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:29.831204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1260/2511] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:29 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:29.832438 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:29.843052 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376082-1d28-40f4-ae0b-0adf74617aa3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:29.905371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:29.905982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:29.906259 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:29.906546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:29.907190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:29.909248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:29.923288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:30.010384 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1252/2512] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:29 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:30.010872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.023849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb379f40-c885-447e-bed7-d00b656b8939 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.027973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.028698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.029265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.029627 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.030450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.032418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.044897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1261/2513] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:30.049117 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.060581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6cf04-eb98-452d-a210-b9bed3ab24d3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.067214 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.067821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.068101 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.068370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.069020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.070626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42577-34bc-4605-8d87-120b2827df48 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.081319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1253/2514] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:30.085738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.096749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714b947-9ad2-462e-9543-18159039161d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.101686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.102339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.102657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.102964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] PATH_INFO: `/v3/projects/f176a133f5ec458db0f8279d4919b5ec/users/e4c2697090a6436c91679eaa16f6f59b/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.119278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f176a133f5ec458db0f8279d4919b5ec, user_id=e4c2697090a6436c91679eaa16f6f59b, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.121924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.210968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1262/2515] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:30 2022] PUT /identity/v3/projects/f176a133f5ec458db0f8279d4919b5ec/users/e4c2697090a6436c91679eaa16f6f59b/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:30.222498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.223001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.223100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.252001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] MFA Rules not processed for user `e4c2697090a6436c91679eaa16f6f59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:30.253355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:30.318743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1254/2516] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:30.323273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.335825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:30.384783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c92-d92d-4305-8f0d-f9a1bc462893 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.389774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.390667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.390667 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.390940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.391605 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.393510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.479274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1263/2517] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:30 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:30.480411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.491849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe695-d2b2-4e34-a839-7450c4258c0c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.553664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.554275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.554603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.556451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.556451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.557471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.632364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1255/2518] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:30 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:30.636183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.647039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9902240-6aad-438a-b7be-3f6f82f8890f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.651802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.652692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.652971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.653392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.654129 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.655956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.667333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1264/2519] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:30.671522 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.682148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae018c-7c64-49a7-bd0d-74fa88daf42c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.686972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.687687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.691933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.691933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] PATH_INFO: `/v3/projects/064a2dbd3cf149a193aae25dd32eb708/users/79cf886c5c8248d4bc75fd42a62356c0/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.704516 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a2dbd3cf149a193aae25dd32eb708, user_id=79cf886c5c8248d4bc75fd42a62356c0, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.707172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.815213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1256/2520] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:30 2022] PUT /identity/v3/projects/064a2dbd3cf149a193aae25dd32eb708/users/79cf886c5c8248d4bc75fd42a62356c0/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:30.819107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.828898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27737a97-718c-4380-aca8-714f50d85153 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.892234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.892965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.893548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.893947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.894840 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.896430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d6377-9a6e-4648-b160-8303c386bb4d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.908523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1265/2521] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:30.912306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:30.923482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a8bb3-5110-4b46-b18b-eecad01993b7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:30.929379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:30.930044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.930718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.930718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] PATH_INFO: `/v3/projects/064a2dbd3cf149a193aae25dd32eb708/users/79cf886c5c8248d4bc75fd42a62356c0/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.932720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a2dbd3cf149a193aae25dd32eb708, user_id=79cf886c5c8248d4bc75fd42a62356c0, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:30.935355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:30.947728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1257/2522] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:30 2022] PUT /identity/v3/projects/064a2dbd3cf149a193aae25dd32eb708/users/79cf886c5c8248d4bc75fd42a62356c0/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:30.959085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:30.959372 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:30.959648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:30.993566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] MFA Rules not processed for user `79cf886c5c8248d4bc75fd42a62356c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:30.994943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:31.074946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1266/2523] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:31.086917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:31.088639 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:31.114782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:31.147343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef40b6-5f2a-45c9-8119-babf3a309941 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:31.152565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:31.153167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:31.153443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:31.153707 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:31.162996 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:31.164442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc9a76-73e7-4680-a764-2181d6b0925d service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:31.175191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1258/2524] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:31.206855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:31.216409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:31.274140 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3734e-ca93-4cda-872f-9683717b5e3e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:31.278685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:31.279498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:31.279786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:31.280062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] PATH_INFO: `/v3/users/e4c2697090a6436c91679eaa16f6f59b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:31.281273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c2697090a6436c91679eaa16f6f59b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:31.284231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:31.505601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c2697090a6436c91679eaa16f6f59b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:31.588207 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c2697090a6436c91679eaa16f6f59b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:31.613841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c2697090a6436c91679eaa16f6f59b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:31.630899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c2697090a6436c91679eaa16f6f59b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:31.632814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c2697090a6436c91679eaa16f6f59b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:31.638367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1267/2525] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:31 2022] DELETE /identity/v3/users/e4c2697090a6436c91679eaa16f6f59b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:31.642903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:31.643347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:31.643575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:31.667242 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:31.668480 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:31.732594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1259/2526] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:31.744258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:31.745742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:31.807956 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733883c-9269-46ae-a6fa-de578c1f44f4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:31.813004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:31.814701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:31.814701 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:31.814916 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:31.827297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:31.829057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:31.839636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1268/2527] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:32.424042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:32.430004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:32.437608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8abd6-38fa-4ecd-9f08-617c3bf0d82c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:32.442728 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:32.443401 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:32.443677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:32.444009 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] PATH_INFO: `/v3/projects/f176a133f5ec458db0f8279d4919b5ec` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:32.445155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f176a133f5ec458db0f8279d4919b5ec)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:32.447098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:32.562051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f176a133f5ec458db0f8279d4919b5ec', 'request_id': 'req-fe81e877-e1be-4b2f-b0d9-32600ce4957b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:32.568982 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f176a133f5ec458db0f8279d4919b5ec', 'request_id': 'req-fe81e877-e1be-4b2f-b0d9-32600ce4957b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:32.644965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f176a133f5ec458db0f8279d4919b5ec', 'request_id': 'req-fe81e877-e1be-4b2f-b0d9-32600ce4957b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:32.658310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] The token cache is being invalidate because project f176a133f5ec458db0f8279d4919b5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:32.658661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:32.659826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:32.664610 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1260/2528] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:32 2022] DELETE /identity/v3/projects/f176a133f5ec458db0f8279d4919b5ec => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:32.666238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:32.676774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14894272-dd74-4f36-be6c-7b8c72bfb5a3 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:32.704267 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:32.739401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:32.740058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:32.740335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:32.740607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] PATH_INFO: `/v3/users/79cf886c5c8248d4bc75fd42a62356c0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:32.741851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79cf886c5c8248d4bc75fd42a62356c0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:32.743651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:32.992442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79cf886c5c8248d4bc75fd42a62356c0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.084672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79cf886c5c8248d4bc75fd42a62356c0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.099924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79cf886c5c8248d4bc75fd42a62356c0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.107050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79cf886c5c8248d4bc75fd42a62356c0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.108082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79cf886c5c8248d4bc75fd42a62356c0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.114505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1269/2529] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:32 2022] DELETE /identity/v3/users/79cf886c5c8248d4bc75fd42a62356c0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:33.180299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:33.182666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.196250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81e877-e1be-4b2f-b0d9-32600ce4957b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:33.247931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:33.262003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:33.263083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.263371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.263642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] PATH_INFO: `/v3/users/e9a03f8c20044a07a229c860773f6ac9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.264841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a03f8c20044a07a229c860773f6ac9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:33.267646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:33.442223 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:33.447061 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.484605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a03f8c20044a07a229c860773f6ac9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.523985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a82c-a210-4293-b7f4-845dd6281df1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:33.529057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:33.529664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.529945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.530222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.532171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.543455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:33.544961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:33.558785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1270/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:33.558785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:33.560130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.574191 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69ca8f-f15c-4c69-9914-c67aa54c7bc5 service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:33.579890 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:33.580528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.580844 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.581110 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] PATH_INFO: `/v3/projects/064a2dbd3cf149a193aae25dd32eb708` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.582322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064a2dbd3cf149a193aae25dd32eb708)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:33.584234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:33.593281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a03f8c20044a07a229c860773f6ac9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.622562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a03f8c20044a07a229c860773f6ac9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.630733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a03f8c20044a07a229c860773f6ac9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.631471 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a03f8c20044a07a229c860773f6ac9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.638834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1261/2531] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:33 2022] DELETE /identity/v3/users/e9a03f8c20044a07a229c860773f6ac9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:33.638834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:33.643547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.718079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:33.727065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81eaa7-554f-4017-8769-9308eaa3e82f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:33.731407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064a2dbd3cf149a193aae25dd32eb708', 'request_id': 'req-3e967a88-3862-43f4-8da6-8d769d8526b9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.747130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064a2dbd3cf149a193aae25dd32eb708', 'request_id': 'req-3e967a88-3862-43f4-8da6-8d769d8526b9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.794394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:33.795058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.795345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.795628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] PATH_INFO: `/v3/users/5e642c2db91e45b38bf777c7a72a5380` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.796851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e642c2db91e45b38bf777c7a72a5380)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:33.799228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:33.816667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:33.825797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064a2dbd3cf149a193aae25dd32eb708', 'request_id': 'req-3e967a88-3862-43f4-8da6-8d769d8526b9'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.841079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] The token cache is being invalidate because project 064a2dbd3cf149a193aae25dd32eb708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3e967a88-3862-43f4-8da6-8d769d8526b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1271/2532] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:33 2022] DELETE /identity/v3/projects/064a2dbd3cf149a193aae25dd32eb708 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d8da-b629-4e78-bc5f-6c57a82fc124 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d8da-b629-4e78-bc5f-6c57a82fc124 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.863322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d8da-b629-4e78-bc5f-6c57a82fc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.869386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ccf3d8da-b629-4e78-bc5f-6c57a82fc124 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:33.870645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ccf3d8da-b629-4e78-bc5f-6c57a82fc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.879323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1272/2533] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:33.880491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.880773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.881045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.900546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:33.901750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.910133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1273/2534] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:33.910800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:33.918366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:33.979546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2517-b3f1-411f-be01-2a001015fa02 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:33.983123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:33.983735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:33.984013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:33.984284 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:33.993740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:33.995189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c2d79-4132-4b7e-86cc-a4f7a540fb06 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.004999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1274/2535] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:34.006132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.006414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.006745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.027322 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:34.028538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.037106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1275/2536] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:34.041213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.053118 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bb778-e675-4687-ac64-78649eae5c9b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.057953 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.059222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.059222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.059456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.060197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:34.060502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.062258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.078707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1276/2537] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:09:34.082288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.095341 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2836e9-6cc3-4402-b85c-3224d674bc4e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.100085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.100941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.101224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.101500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.102156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.104109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.227071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e642c2db91e45b38bf777c7a72a5380'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.252431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1277/2538] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:34 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:34.253260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.255007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.315012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870007b-7628-42dd-ba26-2d48b2a95896 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.319087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.319752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.320031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.320229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e642c2db91e45b38bf777c7a72a5380'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.320388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.322321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.335710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e642c2db91e45b38bf777c7a72a5380'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.343509 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e642c2db91e45b38bf777c7a72a5380'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.344227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e642c2db91e45b38bf777c7a72a5380'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.351018 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1262/2539] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:33 2022] DELETE /identity/v3/users/5e642c2db91e45b38bf777c7a72a5380 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:34.354304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.354304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.396432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.398236 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.411906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1278/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:34.428763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0a61-2544-4e60-b3b4-adfe42dbc18b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.433535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.434143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.434418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.434772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.435442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.437341 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.553780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1263/2541] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:34 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:34.557819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.567581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.569428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.585286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03faea0-8796-4bf8-a7a4-68c05252efd7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.590261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.591003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.591288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.602670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] PATH_INFO: `/v3/projects/6f9f687b6bdc49d09e8620295a2bb2e8` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.605917 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9f687b6bdc49d09e8620295a2bb2e8)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.617846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.637583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ad8b-1835-48fe-a979-e69eff2f38ff service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.646210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.646210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.646210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.646210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.646736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.647106 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.659666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1279/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:34.660530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.664048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.681517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dc33-da80-42bd-a449-56655283222b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.686814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:34.687448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:34.687723 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:34.687994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] PATH_INFO: `/v3/projects/221fb5fed9fb427b9e211eab312ba0de` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:34.689705 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=221fb5fed9fb427b9e211eab312ba0de)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:34.691650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:34.765749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9f687b6bdc49d09e8620295a2bb2e8', 'request_id': 'req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.772394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9f687b6bdc49d09e8620295a2bb2e8', 'request_id': 'req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.780921 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:34.806576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221fb5fed9fb427b9e211eab312ba0de', 'request_id': 'req-8472e6c0-913b-4717-a51a-fcf33a4bf46d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.814034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221fb5fed9fb427b9e211eab312ba0de', 'request_id': 'req-8472e6c0-913b-4717-a51a-fcf33a4bf46d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.879246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9f687b6bdc49d09e8620295a2bb2e8', 'request_id': 'req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.890056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] The token cache is being invalidate because project 6f9f687b6bdc49d09e8620295a2bb2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:34.890346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.891017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.892501 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1264/2543] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:34 2022] DELETE /identity/v3/projects/6f9f687b6bdc49d09e8620295a2bb2e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:34.893280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.894617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:34.960289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555617d2-42c5-4ab9-9cc4-e27d4058fbc9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:34.971159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221fb5fed9fb427b9e211eab312ba0de', 'request_id': 'req-8472e6c0-913b-4717-a51a-fcf33a4bf46d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.982908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] The token cache is being invalidate because project 221fb5fed9fb427b9e211eab312ba0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:34.983510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.984435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:34.986741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1280/2544] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:34 2022] DELETE /identity/v3/projects/221fb5fed9fb427b9e211eab312ba0de => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:34.991896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:34.993830 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=16,keystone:SELECT=79,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:34.996230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.025649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.026360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.026750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.027328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.028115 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.029825 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53451ae4-4d15-4f61-aaf3-465a2fe0e796 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.040678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1265/2545] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:35.042024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.042313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.042890 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.063098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:35.064231 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.069771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472e6c0-913b-4717-a51a-fcf33a4bf46d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.073423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1266/2546] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:35.074099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.074294 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.074987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.075272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.075545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] PATH_INFO: `/v3/users/fa0ce917bbc04bac9d91c6094de56c2a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.076691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0ce917bbc04bac9d91c6094de56c2a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.078614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.079754 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.096824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca1ff-5202-42e8-a169-c3d14cc155c2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.102353 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.103169 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.103371 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.103642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] PATH_INFO: `/v3/projects/c02ed1a29edd4088ba44594317052664/users/b9718febc8864154bd0c3d2b5c3e1996/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.119067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02ed1a29edd4088ba44594317052664, user_id=b9718febc8864154bd0c3d2b5c3e1996, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.121745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef715fd9-f68a-4244-bf54-76c00f021e55 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.210834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1267/2547] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:35 2022] PUT /identity/v3/projects/c02ed1a29edd4088ba44594317052664/users/b9718febc8864154bd0c3d2b5c3e1996/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:35.212305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd233e5-4da8-4cec-902c-715a2de48634 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.212709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd233e5-4da8-4cec-902c-715a2de48634 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.213073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd233e5-4da8-4cec-902c-715a2de48634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.233780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4cd233e5-4da8-4cec-902c-715a2de48634 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:35.235498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4cd233e5-4da8-4cec-902c-715a2de48634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.299528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1268/2548] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:35.299528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.299528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.299528 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.300761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0ce917bbc04bac9d91c6094de56c2a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:35.328661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] MFA Rules not processed for user `b9718febc8864154bd0c3d2b5c3e1996`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:35.330487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.385317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0ce917bbc04bac9d91c6094de56c2a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:35.399914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1269/2549] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:35.400153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0ce917bbc04bac9d91c6094de56c2a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:35.401050 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.409552 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0ce917bbc04bac9d91c6094de56c2a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:35.411131 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0ce917bbc04bac9d91c6094de56c2a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:35.413254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c22c-ca9b-48c6-9982-1c23e1d1a1ed None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.418200 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.418849 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.425104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.425104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.425358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1281/2550] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:34 2022] DELETE /identity/v3/users/fa0ce917bbc04bac9d91c6094de56c2a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:35.425467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:35.426301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.426416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.426551 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.426646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.443682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1270/2551] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:35.448851 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.451815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:35.466274 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f404e-be14-4630-8ad3-ec35def99eb9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.528714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea750e-52e9-41cc-97ea-64c9c2ea727c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.535834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.536588 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.536905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.537264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.538028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.540097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.540642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.541286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.541565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.541837 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.542524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.544684 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.636937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1282/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:35.641049 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1271/2553] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:35.643144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.643485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.734193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:35.736613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da909625-1d2a-4f40-9e9d-ffc49de1aa7c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.748342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.748969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.749444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.749793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.750496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.753750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.777508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24d90d-b481-4168-99cf-d1a80ef26da9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.795613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.796258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.796528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.800737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.800737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.800737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.895400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1272/2554] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:35.899087 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.911295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab183-5433-4a12-96ea-5f8f1b3324bf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.916580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.917598 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.918045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.918473 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.919324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:35.921360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:35.935450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1273/2555] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:35.941249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.964419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fb1ac-060a-4051-b7b5-8e526fbbfe16 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:35.974121 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:35.989529 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1283/2556] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:35 2022] POST /identity/v3/users => generated 294 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:35.994813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:35.995184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:35.995648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:35.998290 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:35.999057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.001248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.012266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce5de6-d492-40d6-b2d2-c9256d231ade admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.019995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.019995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.020331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1274/2557] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:36.020482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.020482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.020482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.021666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.029424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.036862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1284/2558] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:36.043002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.043194 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b6a9b-07a6-4249-b5b4-f47a51545fd2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.046345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.047240 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.048225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.048701 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] PATH_INFO: `/v3/projects/90dd5029fe464b1b958c50c1fa06fe4b/users/ed3c96cf8a08457ba5b6ae4df89db5ba/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.050546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68d990-52e8-4072-8933-8de77f505079 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.056697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.057851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.058230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.058707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.059690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.063066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.072433 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dd5029fe464b1b958c50c1fa06fe4b, user_id=ed3c96cf8a08457ba5b6ae4df89db5ba, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.075382 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.076841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1285/2559] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:36.078931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.082359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.101802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51bd16-e233-418a-8e0f-f7f454df462a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.108310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.108838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.109213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.109716 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] PATH_INFO: `/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.111621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daad1d0395d94deeb1d92e83bfb45b2b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.113752 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.158153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1275/2560] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:36 2022] PUT /identity/v3/projects/90dd5029fe464b1b958c50c1fa06fe4b/users/ed3c96cf8a08457ba5b6ae4df89db5ba/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:36.159097 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.251712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daad1d0395d94deeb1d92e83bfb45b2b', 'request_id': 'req-d8021f8f-9392-4c15-b482-541809437114'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:36.261586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daad1d0395d94deeb1d92e83bfb45b2b', 'request_id': 'req-d8021f8f-9392-4c15-b482-541809437114'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:36.307691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a164009-5fef-48b0-97aa-0170dc1aa051 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.312047 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:36.359036 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daad1d0395d94deeb1d92e83bfb45b2b', 'request_id': 'req-d8021f8f-9392-4c15-b482-541809437114'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:36.372646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] The token cache is being invalidate because project daad1d0395d94deeb1d92e83bfb45b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:36.372646 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:36.374302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d8021f8f-9392-4c15-b482-541809437114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:36.377700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1286/2561] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:36 2022] DELETE /identity/v3/projects/daad1d0395d94deeb1d92e83bfb45b2b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:36.380510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6ba9-82c4-4806-b573-99fd7c4851ef None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.382772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6ba9-82c4-4806-b573-99fd7c4851ef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.383068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca6ba9-82c4-4806-b573-99fd7c4851ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.412081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.412997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.413276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.413562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] PATH_INFO: `/v3/projects/ee56ef5385064d198cef26aee1573825/users/6a1868bf205144a3b620368b06dad42e/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.424369 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3cca6ba9-82c4-4806-b573-99fd7c4851ef None None] MFA Rules not processed for user `ed3c96cf8a08457ba5b6ae4df89db5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:36.427153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3cca6ba9-82c4-4806-b573-99fd7c4851ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.433485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee56ef5385064d198cef26aee1573825, user_id=6a1868bf205144a3b620368b06dad42e, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.437015 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1102f-7a07-4bcc-82b3-0afae8a026ef admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.514126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1276/2562] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:36 2022] PUT /identity/v3/projects/ee56ef5385064d198cef26aee1573825/users/6a1868bf205144a3b620368b06dad42e/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:36.517456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943d76-d705-4512-8271-ed31a745880b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.517712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943d76-d705-4512-8271-ed31a745880b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.517985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c943d76-d705-4512-8271-ed31a745880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.525907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1287/2563] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:36.527697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a13b-dbaa-452e-915d-c4f2de691ca5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.527978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a13b-dbaa-452e-915d-c4f2de691ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.528251 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a13b-dbaa-452e-915d-c4f2de691ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.552677 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4c943d76-d705-4512-8271-ed31a745880b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:36.553922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4c943d76-d705-4512-8271-ed31a745880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.567165 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-78a6a13b-dbaa-452e-915d-c4f2de691ca5 None None] MFA Rules not processed for user `6a1868bf205144a3b620368b06dad42e`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:36.570088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78a6a13b-dbaa-452e-915d-c4f2de691ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.630235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1277/2564] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:36.630235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c943d76-d705-4512-8271-ed31a745880b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.630235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4c943d76-d705-4512-8271-ed31a745880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.647989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1288/2565] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:36.649886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.650215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.650482 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.672136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:36.673930 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.682564 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1289/2566] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:36.687827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.691070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.695248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c943d76-d705-4512-8271-ed31a745880b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.699601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.704339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.704339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.704339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.704634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9dbf0-bb8a-43d6-b114-aa25d539a5df None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.709222 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.709940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.710281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.710639 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.711302 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.713282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.764874 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.766885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928a474-e48a-4d9a-bff4-bf91029aabae service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.776354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1278/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:36.778565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.778565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.778565 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.799172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:36.800503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.810417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1279/2568] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:36.811199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.820824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e62a6-ec45-44db-89d7-18b2caad6ad8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.825760 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.834419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.836999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1290/2569] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:36.838568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.841332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:36.848311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1280/2570] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:36.849028 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.859796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351daeb-d34d-4f67-a359-2827ca61ae52 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.932323 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.933057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.933455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.933735 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.934366 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.936304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.949360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696293d1-95ec-4d97-ac10-930743585873 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.955917 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.956528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.956811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.957087 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.965539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.967307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:36.977570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1291/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:36.978443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:36.988278 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c33f0-6932-40d7-8f06-1b1f09cdd2b5 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:36.993040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:36.993625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:36.993906 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:36.994210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:36.994882 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:36.996857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.037271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1281/2572] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:37.041156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.050878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440091-42d6-43dd-bd15-959e97ee91c6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.055916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.056482 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.058611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.058611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.058611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.059420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.070136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1282/2573] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:37.073909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.083034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdb2dc-661c-44e1-958f-04651ca2b6ad admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.087667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.088264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.088543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.088811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] PATH_INFO: `/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca/users/68c2dd531bdd44348c6e69e66445b4a1/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.103001 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89afc91810f6444cb6c4ba556dd7f6ca, user_id=68c2dd531bdd44348c6e69e66445b4a1, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.105574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.113056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1292/2574] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:36 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:37.119400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.168601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1283/2575] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:37 2022] PUT /identity/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca/users/68c2dd531bdd44348c6e69e66445b4a1/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:37.172286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.178897 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acf32b-ad87-487d-bf49-94ea702e9697 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.233550 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf6531-e8cb-4268-87b3-b909fa8ab420 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.236089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.236712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.236986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.237256 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.237878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.239318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.239828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.239948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.240238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.240552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.241190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.243017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.253568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1284/2576] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:37.258324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.267607 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f663a3-86e1-49a7-9bdc-77bc0a337da8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.272327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.272968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.273245 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.273518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] PATH_INFO: `/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca/users/68c2dd531bdd44348c6e69e66445b4a1/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.275505 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89afc91810f6444cb6c4ba556dd7f6ca, user_id=68c2dd531bdd44348c6e69e66445b4a1, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.278096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df8db2-c5e2-4290-a71c-275181536f39 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.288502 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1285/2577] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:37 2022] PUT /identity/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca/users/68c2dd531bdd44348c6e69e66445b4a1/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:37.299244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.299539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.299818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.328373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] MFA Rules not processed for user `68c2dd531bdd44348c6e69e66445b4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:37.330223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:37.339512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1293/2578] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:37 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:37.343621 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.347727 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:37.354045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2b5ad-9b08-4ffe-aeb2-dbdd8bf5130e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.404123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1286/2579] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:37.413880 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.415766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.416078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:37.416655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.417180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.417309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:37.417466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.418141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.419728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.433612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1294/2580] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:37.434636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.444548 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00df6-89a4-4e36-a7e8-58bb6c69d600 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.452228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.454566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.454847 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.455113 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.455757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.457327 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.485758 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1295/2581] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:37.486870 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.501542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef446b-db89-440b-bec6-cd7f47154272 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.510947 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.511685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.512033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.512364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] PATH_INFO: `/v3/projects/2b5868380eff4fbababf4e1b874422eb/users/b611a71eb0314bc0a6fa27c78fa48d63/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.530569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5868380eff4fbababf4e1b874422eb, user_id=b611a71eb0314bc0a6fa27c78fa48d63, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.533941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.578539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c35ff-69f3-4c75-ac98-4830fd1363e0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.584455 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.585280 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.585733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.586011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.596772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.598504 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83706f6-72d8-4f63-9b66-e254fa921f8b service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.609719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1287/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:37.660992 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1296/2583] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:37 2022] PUT /identity/v3/projects/2b5868380eff4fbababf4e1b874422eb/users/b611a71eb0314bc0a6fa27c78fa48d63/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:37.668657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.669061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.669342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.706077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] MFA Rules not processed for user `b611a71eb0314bc0a6fa27c78fa48d63`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:37.706077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:37.777977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1288/2584] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:37.782749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.841912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3257b-3b17-43be-98ee-27ada02a9ae5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:37.847228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:37.847836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:37.848229 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:37.848402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:37.849000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:37.850985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:37.970824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1297/2585] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:37 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:37.974750 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:37.986336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45153dc6-b725-4088-836c-90aee8b04982 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.041548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.042163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.042578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.046769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.046769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.046769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.093829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:38.128454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1289/2586] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:37 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:38.132421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.142771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2e70b-02df-438d-a2e8-aab92e0d38af admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.148288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.148878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.149196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.149465 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.150098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.151703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.161927 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1298/2587] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:38.166114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.176777 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2306-d3b7-44e5-87c9-a79295421760 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.181330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.181967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.182246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.182543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] PATH_INFO: `/v3/projects/6c45648454a04204b495554e976cab5c/users/2a08f1699b6d4552b535cf86e5ce37af/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.198252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c45648454a04204b495554e976cab5c, user_id=2a08f1699b6d4552b535cf86e5ce37af, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.200904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.276732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1290/2588] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:38 2022] PUT /identity/v3/projects/6c45648454a04204b495554e976cab5c/users/2a08f1699b6d4552b535cf86e5ce37af/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:38.280664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.290387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e984da-0e65-4a7f-a6a6-1e5308316fa1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.348188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.350032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.350032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.350032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.350032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.351640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad841a-6429-4f45-ac4e-7caf73c86cf7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.362835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1299/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:38.365833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.377489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847ad2-0540-4407-af75-a4e7de54f509 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.382715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.383361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.383638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.383906 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] PATH_INFO: `/v3/projects/6c45648454a04204b495554e976cab5c/users/2a08f1699b6d4552b535cf86e5ce37af/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.385808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c45648454a04204b495554e976cab5c, user_id=2a08f1699b6d4552b535cf86e5ce37af, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.388421 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.398848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1291/2590] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:38 2022] PUT /identity/v3/projects/6c45648454a04204b495554e976cab5c/users/2a08f1699b6d4552b535cf86e5ce37af/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:38.409450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.409735 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.410034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.437232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] MFA Rules not processed for user `2a08f1699b6d4552b535cf86e5ce37af`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:38.438500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:38.507098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1300/2591] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:38.518629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.519536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:38.574569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420886-6e12-4013-9456-d3784996bd1e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.578092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.578722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.579002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.579275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.588514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.589932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.599839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1292/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:38.721295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:38.774792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:38.788266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb05ee-7cf8-4fbf-b7af-dccbb145b58c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:38.793377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:38.794072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:38.794399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:38.794745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:38.880523 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:38.882883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:38.909073 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1301/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:38.957451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:39.024024 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:39.032748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85bb0-bc98-4113-899a-ecb77020ae11 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:39.037991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:39.038695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:39.038975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:39.039285 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:39.041314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:39.043871 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:39.102503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:39.103977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703d78-ebd1-4772-b1af-31cc794896f3 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:39.113800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1293/2594] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:39.511736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:39.765657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:40.191242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:40.257382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648556b-0bbc-4590-8aa1-2717e6e8c3bf service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:40.262057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:40.263105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:40.263105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:40.263309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] PATH_INFO: `/v3/users/b611a71eb0314bc0a6fa27c78fa48d63` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:40.264456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b611a71eb0314bc0a6fa27c78fa48d63)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:40.266964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:40.458039 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:40.471777 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b611a71eb0314bc0a6fa27c78fa48d63'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:40.553320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b611a71eb0314bc0a6fa27c78fa48d63'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:40.568000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b611a71eb0314bc0a6fa27c78fa48d63'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:40.574901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b611a71eb0314bc0a6fa27c78fa48d63'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:40.575603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b611a71eb0314bc0a6fa27c78fa48d63'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:40.582024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1302/2595] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:40 2022] DELETE /identity/v3/users/b611a71eb0314bc0a6fa27c78fa48d63 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:40.587265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:40.588275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:40.591798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:40.608166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:40.609376 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:40.668251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1294/2596] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:40.678116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:40.679663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:40.743300 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1810-f68a-4c74-8a3c-9d56bb62095d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:40.747311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:40.747910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:40.748183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:40.748557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:40.757849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:40.759337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:40.770317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1303/2597] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:41.198063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:41.202243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:41.228866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d75b9-5c14-43ff-912a-e663374b2d13 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:41.234602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:41.235941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:41.236213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:41.236476 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] PATH_INFO: `/v3/projects/2b5868380eff4fbababf4e1b874422eb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:41.237621 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5868380eff4fbababf4e1b874422eb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:41.239593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:41.368294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5868380eff4fbababf4e1b874422eb', 'request_id': 'req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.374346 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5868380eff4fbababf4e1b874422eb', 'request_id': 'req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.484212 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5868380eff4fbababf4e1b874422eb', 'request_id': 'req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.496298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] The token cache is being invalidate because project 2b5868380eff4fbababf4e1b874422eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:41.496605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.502832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-350bcb24-92e5-49a9-a7bb-6f92b0e4e3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.504387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1295/2598] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:41 2022] DELETE /identity/v3/projects/2b5868380eff4fbababf4e1b874422eb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:41.508358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:41.514383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:41.518790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabd37-c2d7-4612-bdd7-1b1c4e8331d4 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:41.581238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:41.581941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:41.582288 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:41.582665 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] PATH_INFO: `/v3/users/2a08f1699b6d4552b535cf86e5ce37af` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:41.583910 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a08f1699b6d4552b535cf86e5ce37af)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:41.585834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:41.787998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a08f1699b6d4552b535cf86e5ce37af'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.868209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a08f1699b6d4552b535cf86e5ce37af'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.882528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a08f1699b6d4552b535cf86e5ce37af'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.889489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a08f1699b6d4552b535cf86e5ce37af'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.890230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a08f1699b6d4552b535cf86e5ce37af'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:41.896272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1304/2599] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:41 2022] DELETE /identity/v3/users/2a08f1699b6d4552b535cf86e5ce37af => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:42.127503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.127979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.128077 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.137123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:42.149201 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:42.150199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.210952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1296/2600] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:42.232017 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:42.233431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.333269 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86cb6e-9f40-4465-88f0-d46e783ad294 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:42.339199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:42.339896 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.340239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.340579 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.349742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:42.351425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:42.361934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1305/2601] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:42.383703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:42.386957 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.407866 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c28d9-2ccb-4870-8cac-5752b4d659eb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:42.414500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:42.426478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.426478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.426478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] PATH_INFO: `/v3/projects/6c45648454a04204b495554e976cab5c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.426478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c45648454a04204b495554e976cab5c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:42.426478 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:42.571257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c45648454a04204b495554e976cab5c', 'request_id': 'req-cd0a9325-4ab4-4aea-9352-b67d2009697f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:42.579420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c45648454a04204b495554e976cab5c', 'request_id': 'req-cd0a9325-4ab4-4aea-9352-b67d2009697f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:42.651068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c45648454a04204b495554e976cab5c', 'request_id': 'req-cd0a9325-4ab4-4aea-9352-b67d2009697f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:42.655095 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:42.657563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.666035 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] The token cache is being invalidate because project 6c45648454a04204b495554e976cab5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:42.666331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:42.673377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cd0a9325-4ab4-4aea-9352-b67d2009697f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:42.674860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1297/2602] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:42 2022] DELETE /identity/v3/projects/6c45648454a04204b495554e976cab5c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:42.675257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:42.680192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579391c9-ecaf-4664-bc1f-a0f2ceb5d95e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.680811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579391c9-ecaf-4664-bc1f-a0f2ceb5d95e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.681095 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579391c9-ecaf-4664-bc1f-a0f2ceb5d95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.707667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-579391c9-ecaf-4664-bc1f-a0f2ceb5d95e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:42.708461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-579391c9-ecaf-4664-bc1f-a0f2ceb5d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.727180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07008d15-2eae-4fc2-8195-f1c69e0ba59a service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:42.780682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:42.781298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.781628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.782404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.784190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.786556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1298/2603] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:42.794138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.794539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.794989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.800460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:42.802164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:42.816114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1306/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:42.817616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:42.819203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:42.832885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1299/2605] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:42.834127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:42.847081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3791ef-8cdb-4a8b-a81f-deb5cfbd09ed service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:42.851977 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:42.852651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.853121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.853456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.854297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:42.854737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:42.856367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:42.869443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1307/2606] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:42.873793 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:42.884616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aec06-fbbe-475b-9878-ea267ac0b207 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:42.889479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:42.890082 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:42.890453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:42.890771 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:42.892034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:42.893909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.022307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:43.033489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1300/2607] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:43.034968 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:43.046114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a48f7-43f0-4dd6-afb5-365070307da9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:43.124032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:43.124645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.124918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.125184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.125877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:43.127815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.232325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1308/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:43 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:43.237166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:43.247762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcd8b-c399-408d-83f0-c12e3912341d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:43.254846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:43.255112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.255450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.255873 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.256537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:43.259633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.271080 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1301/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:43.275307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:43.287085 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf0257-5914-4303-874e-a44e7a4568a6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:43.292441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:43.293328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.293613 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.293891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.294683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:43.296656 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee8f99-62fa-43fd-8aa3-0f3251f6c815 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.309823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1309/2610] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:43.314979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:43.327546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeb103-ca6c-4ed7-9e66-55353c2c2146 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:43.333390 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:43.334167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.334599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.334966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] PATH_INFO: `/v3/projects/e85f665484774cc2a8d940a96f2ed1b8/users/1322bb5640a34b6eb86f181dc64f82f3/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.358713 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85f665484774cc2a8d940a96f2ed1b8, user_id=1322bb5640a34b6eb86f181dc64f82f3, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:43.359297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.446122 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b238-6de6-4a2d-a5d8-26582910ea2b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.446421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b238-6de6-4a2d-a5d8-26582910ea2b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.446729 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61b238-6de6-4a2d-a5d8-26582910ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.449464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1302/2611] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:43 2022] PUT /identity/v3/projects/e85f665484774cc2a8d940a96f2ed1b8/users/1322bb5640a34b6eb86f181dc64f82f3/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:43.472603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6e61b238-6de6-4a2d-a5d8-26582910ea2b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:43.474439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6e61b238-6de6-4a2d-a5d8-26582910ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:43.528123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:43.565728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1310/2612] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:43.580036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:43.584031 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:43.660227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c7495-0b4e-4556-87a0-f7c919a89a67 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:43.665310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:43.665929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:43.666210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:43.666484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:43.680011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:43.681575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:43.693678 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1303/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:45.514861 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:45.515324 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:45.515468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:45.520189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:45.521602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:45.579609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] MFA Rules not processed for user `1322bb5640a34b6eb86f181dc64f82f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:45.583772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:45.611902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bc7da-f7ce-497d-babe-a2f3d6cfa09a service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:45.641602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:45.642365 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:45.642848 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:45.643217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:45.647452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:45.706751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1311/2614] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:45.711756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:45.741974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744d3d-d3ab-4621-85af-aa894110078e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:45.741974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:45.741974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:45.741974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:45.742776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:45.742776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:45.742776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:45.759030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:45.760578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:45.776367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1304/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:45.889881 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1312/2616] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:45 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:45.894333 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:45.905885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2dcbe-c7f9-470d-9d05-149ef6899948 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:45.923591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:45.968299 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:45.969674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:45.969959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:45.970307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:45.970983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:45.973547 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.131099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1305/2617] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:45 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:46.134816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:46.150683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ef80-aca3-4a32-a2d7-b2a6feed1e75 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:46.156160 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:46.157415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.157694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.157966 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.158755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:46.160379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f6e80-9c60-415c-a400-6c4fae18aaac admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.185011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1313/2618] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:46.186233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:46.205541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3763f99-2751-484f-bc7e-9c800a420dae admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:46.221079 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:46.222013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.223216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.224822 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] PATH_INFO: `/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77/users/9e085735ae4c41c7941082051101febc/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.262847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d40d9397ae4d25ae4cd043f9ec0a77, user_id=9e085735ae4c41c7941082051101febc, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:46.267023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.287790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.288144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.289742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.317547 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:46.318948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:46.328214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1314/2619] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:46.350429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:46.367437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:46.370566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1306/2620] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:46 2022] PUT /identity/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77/users/9e085735ae4c41c7941082051101febc/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:46.374597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:46.512044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd3351-0c71-43b9-a7bd-a1b0efc8f9ac admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:46.525152 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:46.526440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.526833 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.527156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.527297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf92cbd-1b24-40d6-9a27-bc266daa4853 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:46.529775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:46.533828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.551539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:46.565356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1307/2621] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:46.567646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:46.596922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d806-721c-4985-a8b7-c12da2339048 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:46.610892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:46.611573 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.611854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.612219 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] PATH_INFO: `/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77/users/9e085735ae4c41c7941082051101febc/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.618014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:46.624149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:46.624149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:46.624149 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:46.624552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d40d9397ae4d25ae4cd043f9ec0a77, user_id=9e085735ae4c41c7941082051101febc, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:46.624552 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.631607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:46.633189 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605f49-435f-4ffe-8622-4f7d6033c5f7 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:46.638767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1308/2622] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:46 2022] PUT /identity/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77/users/9e085735ae4c41c7941082051101febc/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:46.644654 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1315/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:47.682409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:47.684399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:47.771803 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c5007-2c04-4ee8-af79-34889539cdad admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:47.777637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:47.778591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:47.779091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:47.779484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] PATH_INFO: `/v3/users/ed3c96cf8a08457ba5b6ae4df89db5ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:47.780916 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3c96cf8a08457ba5b6ae4df89db5ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:47.783685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:47.797871 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:47.995218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3c96cf8a08457ba5b6ae4df89db5ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:48.065802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3c96cf8a08457ba5b6ae4df89db5ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:48.084718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3c96cf8a08457ba5b6ae4df89db5ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:48.092297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3c96cf8a08457ba5b6ae4df89db5ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:48.093045 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3c96cf8a08457ba5b6ae4df89db5ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:48.099619 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1309/2624] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:47 2022] DELETE /identity/v3/users/ed3c96cf8a08457ba5b6ae4df89db5ba => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:48.104090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0a688-c9c1-4ce4-9ba8-9aa05a01ac78 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:48.104570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0a688-c9c1-4ce4-9ba8-9aa05a01ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:48.104686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0a688-c9c1-4ce4-9ba8-9aa05a01ac78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:48.123353 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5ef0a688-c9c1-4ce4-9ba8-9aa05a01ac78 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:48.124560 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ef0a688-c9c1-4ce4-9ba8-9aa05a01ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:48.192058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1316/2625] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:48.202067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:48.204314 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:48.263083 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0b93-cf33-4aa0-8b99-916f6ebdb3d3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:48.266934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:48.267616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:48.267901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:48.270051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:48.277883 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:48.279334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:48.291887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1310/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:48.719640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114313-a198-4a06-a612-b9eaded42805 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:48.720587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114313-a198-4a06-a612-b9eaded42805 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:48.721640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114313-a198-4a06-a612-b9eaded42805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:48.762088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d4114313-a198-4a06-a612-b9eaded42805 None None] MFA Rules not processed for user `9e085735ae4c41c7941082051101febc`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:48.763887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d4114313-a198-4a06-a612-b9eaded42805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:48.839953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:48.841331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:48.858893 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7258d3-f58a-47cd-9f53-0240d6f9f1a4 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:48.868708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:48.870743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:48.871556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:48.871928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] PATH_INFO: `/v3/projects/90dd5029fe464b1b958c50c1fa06fe4b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:48.874568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90dd5029fe464b1b958c50c1fa06fe4b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:48.877432 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:48.882042 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1317/2627] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:48.897121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:48.897439 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:48.897849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:48.935392 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] MFA Rules not processed for user `1322bb5640a34b6eb86f181dc64f82f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:48.936626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:48.970501 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:49.006718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1318/2628] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:49.014498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:49.016027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.050796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90dd5029fe464b1b958c50c1fa06fe4b', 'request_id': 'req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:49.057603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90dd5029fe464b1b958c50c1fa06fe4b', 'request_id': 'req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:49.101008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99e9b-8267-4ea7-b15b-00ff324110b5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:49.163694 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:49.164358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.164698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.164975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.166860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.186266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90dd5029fe464b1b958c50c1fa06fe4b', 'request_id': 'req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:49.202902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] The token cache is being invalidate because project 90dd5029fe464b1b958c50c1fa06fe4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:49.204436 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:49.205458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a6286dbc-8fbb-4c97-a8ac-82cc0a3cd74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:49.207954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1311/2629] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:48 2022] DELETE /identity/v3/projects/90dd5029fe464b1b958c50c1fa06fe4b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:49.212675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.212958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.213229 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.231271 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:49.232850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e493f-3979-494e-a0cc-97ed0660f2f0 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:49.233543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:49.234973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.242718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1319/2630] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:49.262836 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:49.330969 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1312/2631] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:49.338875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.339377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.339831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.374114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:49.375631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.390574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1320/2632] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:49.394863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:49.410992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b674e-642b-41b8-acfe-175d3f6a2087 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:49.426980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:49.427609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.427887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.428465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.428809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:49.432442 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:49.435443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca4bd1-72d8-4b46-97eb-6b4fb0c19bc5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:49.461548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1313/2633] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:49.467008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:49.477902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7e31-8b0c-4395-af46-1e20c3765f79 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:49.483380 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:49.484084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.484448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.484810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.485666 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:49.487739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:49.612520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.613772 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.614234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.636500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1321/2634] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:49 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:49.636500 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:49.649098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:49.650347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.656781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:49.763311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c14b-e3a2-4a63-b26f-91318e4c5e5a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:49.776382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:49.778013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.780247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.780673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.782028 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:49.785485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1314/2635] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:49.787477 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:49.807747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:49.809730 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:49.915431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cc8dd-c003-4b3e-9371-8b95dd84695a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:49.921385 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:49.922089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:49.922413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:49.922717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:49.938570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:49.942301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:49.956359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1315/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:49.966022 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1322/2637] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:49 2022] POST /identity/v3/users => generated 287 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:49.972600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.001796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb409-3f31-467a-8e0a-875a6b86094b service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.013923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.014877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.015369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.016578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.017483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.019334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.030827 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1316/2638] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:50.035604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.046426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0afa41-dd7d-4480-b3c3-a78f21b584c5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.054696 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.055623 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.056146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.056630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.057661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.059584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3a2a0-e339-4fe6-8779-ae6d82ea7166 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.093485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1323/2639] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:50.095568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.108575 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf24f-3bd7-4bbf-8480-dc056ac8b31e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.115949 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.121576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.121576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.121576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] PATH_INFO: `/v3/projects/37a78c0b8c764ce5ac41cf5d1d64e75b/users/1164b215908f4237afe4e060162e66f2/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.138196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a78c0b8c764ce5ac41cf5d1d64e75b, user_id=1164b215908f4237afe4e060162e66f2, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.141999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.252834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1317/2640] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:50 2022] PUT /identity/v3/projects/37a78c0b8c764ce5ac41cf5d1d64e75b/users/1164b215908f4237afe4e060162e66f2/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:50.263239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.263685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.263781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.292445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] MFA Rules not processed for user `1164b215908f4237afe4e060162e66f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:50.293692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:50.358826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1324/2641] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:50.363444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.451675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc868-7360-4a0a-9460-ae169b666783 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.457356 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.458213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.461462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.461462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.461462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.462605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.593013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.595082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:50.620008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1318/2642] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:50.626062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.630287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332780a-e475-4c6e-bb6b-33f510304358 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.701174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:50.706205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965dee-47e8-4ffe-b329-12180c54c137 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.710306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.710920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.713885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.713885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.714090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.714184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] PATH_INFO: `/v3/users/b9718febc8864154bd0c3d2b5c3e1996` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.714276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.714276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.714276 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.714576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9718febc8864154bd0c3d2b5c3e1996)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.714576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.714749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.788450 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1319/2643] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:50 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:50.792211 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.802932 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c459f5-43a8-4f1b-994f-81630e1ccffd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.807743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.808388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.808665 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.809012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.809646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.811250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.821774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1320/2644] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:50.825774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:50.835112 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb47b-f9ca-4ea6-9727-1933e3b4a24b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:50.839799 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:50.840434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:50.840708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:50.840979 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] PATH_INFO: `/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b/users/befdb8d231634e43899de51467d62502/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:50.856517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] RBAC: Authorizing `identity:create_grant(project_id=244f12b35c5e49d6b1d822a09f1cbf9b, user_id=befdb8d231634e43899de51467d62502, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:50.859203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:50.998781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9718febc8864154bd0c3d2b5c3e1996'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:51.062124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1321/2645] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:50 2022] PUT /identity/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b/users/befdb8d231634e43899de51467d62502/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:51.066617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:51.090904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9718febc8864154bd0c3d2b5c3e1996'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:51.095010 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:51.105198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9718febc8864154bd0c3d2b5c3e1996'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:51.112257 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9718febc8864154bd0c3d2b5c3e1996'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:51.112981 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e62961c3-a028-4ed0-a570-f4b65840b3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9718febc8864154bd0c3d2b5c3e1996'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:51.119137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1325/2646] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:50 2022] DELETE /identity/v3/users/b9718febc8864154bd0c3d2b5c3e1996 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:51.123205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.123531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.123763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.133913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6ea4-c44e-4abd-9b2e-0520fbb8851c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:51.145642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:51.145642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:51.226139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1326/2647] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:51.233256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:51.234251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.234746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.235405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.236489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:51.238824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:51.240063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:51.241816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:51.254337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1322/2648] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:51.255535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:51.257643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:51.272764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a387f04-0df0-4482-bc28-f46aaab434e6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:51.279457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:51.281896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.282215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.282499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] PATH_INFO: `/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b/users/befdb8d231634e43899de51467d62502/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.285012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244f12b35c5e49d6b1d822a09f1cbf9b, user_id=befdb8d231634e43899de51467d62502, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:51.288629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2894f-212f-4313-a626-b275c0737fc9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:51.303373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1323/2649] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:51 2022] PUT /identity/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b/users/befdb8d231634e43899de51467d62502/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:51.315692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.315985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.316359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.318217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c3d8-c203-4d63-9d8f-9dbebc9e6d32 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:51.358217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] MFA Rules not processed for user `befdb8d231634e43899de51467d62502`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:51.360640 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:51.429367 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:51.442533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:51.443174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.443565 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.443692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.495173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1324/2650] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:51.527443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:51.529295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:51.552030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:51.587942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:51.590301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:51.616950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1327/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:51.654133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d72385-5236-49a9-b38b-b8940ce0d1e3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:51.681425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:51.681700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:51.681934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:51.682213 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:51.694198 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:51.695963 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:51.706689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1325/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:52.290925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:52.292834 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:52.301399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:52.304718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:52.311566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da233e4-29ae-4067-b6ea-cbe9c8fe96d3 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:52.323733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dfd24-c6b4-4c7e-aef4-a1e604ade8f9 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:52.328852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:52.329801 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:52.330230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:52.330687 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] PATH_INFO: `/v3/users/2fe33635ea3b4ad48169a791d30d297d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:52.330833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:52.331461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:52.331741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:52.332045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] PATH_INFO: `/v3/projects/c02ed1a29edd4088ba44594317052664` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:52.333162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe33635ea3b4ad48169a791d30d297d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:52.333305 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02ed1a29edd4088ba44594317052664)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:52.335159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:52.335537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:52.513581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:52.524571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02ed1a29edd4088ba44594317052664', 'request_id': 'req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.531781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02ed1a29edd4088ba44594317052664', 'request_id': 'req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.536017 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe33635ea3b4ad48169a791d30d297d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.602531 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02ed1a29edd4088ba44594317052664', 'request_id': 'req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.614091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] The token cache is being invalidate because project c02ed1a29edd4088ba44594317052664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:52.614383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.615035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.616506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1328/2653] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:52 2022] DELETE /identity/v3/projects/c02ed1a29edd4088ba44594317052664 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:52.620266 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:52.621570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:52.683980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72d66-c4a9-4758-b715-ad6b7f5c26b7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:52.687991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe33635ea3b4ad48169a791d30d297d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.689660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:52.690303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:52.690653 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:52.690979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] PATH_INFO: `/v3/users/6a1868bf205144a3b620368b06dad42e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:52.692459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1868bf205144a3b620368b06dad42e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:52.696697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:52.714394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe33635ea3b4ad48169a791d30d297d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.723984 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe33635ea3b4ad48169a791d30d297d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.724931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe33635ea3b4ad48169a791d30d297d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.733075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1326/2654] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:52 2022] DELETE /identity/v3/users/2fe33635ea3b4ad48169a791d30d297d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:52.965354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1868bf205144a3b620368b06dad42e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:52.989262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:52.990755 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.056846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2d2b3-f26a-4554-a407-5f1a11fb539a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:53.062475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:53.063172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.063448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.063717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] PATH_INFO: `/v3/users/1164b215908f4237afe4e060162e66f2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.065362 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1164b215908f4237afe4e060162e66f2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:53.067316 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:53.110483 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1868bf205144a3b620368b06dad42e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.113426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:53.127946 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1868bf205144a3b620368b06dad42e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.135280 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1868bf205144a3b620368b06dad42e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.136570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1868bf205144a3b620368b06dad42e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.146412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1329/2655] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:52 2022] DELETE /identity/v3/users/6a1868bf205144a3b620368b06dad42e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:53.146412 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:53.146912 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.226661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca75d93-3ec0-4554-b92b-d2aec258dcca admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:53.232839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:53.233819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.234139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.235186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] PATH_INFO: `/v3/projects/86c3d573598345da9d30423701d32c92` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.238858 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c3d573598345da9d30423701d32c92)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:53.242242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:53.272518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1164b215908f4237afe4e060162e66f2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.375861 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1164b215908f4237afe4e060162e66f2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.396394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1164b215908f4237afe4e060162e66f2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.406708 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1164b215908f4237afe4e060162e66f2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.412256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3033f14a-cb7c-4b68-806a-6991e0004cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1164b215908f4237afe4e060162e66f2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.419261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1327/2656] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:52 2022] DELETE /identity/v3/users/1164b215908f4237afe4e060162e66f2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:53.420723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.421008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.421339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.421824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c3d573598345da9d30423701d32c92', 'request_id': 'req-99007386-f375-4d9c-acb4-f78134dab16d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.429928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c3d573598345da9d30423701d32c92', 'request_id': 'req-99007386-f375-4d9c-acb4-f78134dab16d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.445223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:53.446429 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.510072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1328/2657] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:53.517448 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c3d573598345da9d30423701d32c92', 'request_id': 'req-99007386-f375-4d9c-acb4-f78134dab16d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.523232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:53.526386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.531426 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] The token cache is being invalidate because project 86c3d573598345da9d30423701d32c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:53.531790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.533180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.535441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1330/2658] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:53 2022] DELETE /identity/v3/projects/86c3d573598345da9d30423701d32c92 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:53.539044 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:53.545829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.597238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fc8fc-aa6b-40f0-9911-3cd30d3b36f5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:53.601370 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:53.601972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.602283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.602608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.604518 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.620901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:53.627810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007386-f375-4d9c-acb4-f78134dab16d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:53.633241 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:53.633417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:53.633925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.634205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.634590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] PATH_INFO: `/v3/users/9890d228f7b54cad819f65a96f10e12f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.635164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:53.635795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9890d228f7b54cad819f65a96f10e12f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:53.637757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:53.648789 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1329/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:53.649846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:53.658126 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:53.674189 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72fa6-b85d-4912-adb8-73e09cd53695 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:53.684127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:53.684127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:53.684127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:53.684127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] PATH_INFO: `/v3/projects/ee56ef5385064d198cef26aee1573825` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:53.684705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee56ef5385064d198cef26aee1573825)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:53.685857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:53.890385 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9890d228f7b54cad819f65a96f10e12f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.896400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee56ef5385064d198cef26aee1573825', 'request_id': 'req-3f161ab0-d457-4998-ae17-fe895e9e051c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:53.912061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee56ef5385064d198cef26aee1573825', 'request_id': 'req-3f161ab0-d457-4998-ae17-fe895e9e051c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.021884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9890d228f7b54cad819f65a96f10e12f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.036848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9890d228f7b54cad819f65a96f10e12f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.044965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9890d228f7b54cad819f65a96f10e12f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.046217 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9890d228f7b54cad819f65a96f10e12f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.054498 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1331/2660] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:53 2022] DELETE /identity/v3/users/9890d228f7b54cad819f65a96f10e12f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:54.110358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee56ef5385064d198cef26aee1573825', 'request_id': 'req-3f161ab0-d457-4998-ae17-fe895e9e051c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.125548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] The token cache is being invalidate because project ee56ef5385064d198cef26aee1573825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:54.125901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.127252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.129104 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1330/2661] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:53 2022] DELETE /identity/v3/projects/ee56ef5385064d198cef26aee1573825 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:54.132961 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:54.134538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:54.252680 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a99e-7212-499f-bc5e-75d75ecb51b5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:54.259637 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:54.260473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:54.260816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:54.261155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] PATH_INFO: `/v3/users/68c2dd531bdd44348c6e69e66445b4a1` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:54.262562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c2dd531bdd44348c6e69e66445b4a1)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:54.264800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:54.279477 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:54.287517 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:54.374067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f161ab0-d457-4998-ae17-fe895e9e051c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:54.382156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:54.382156 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:54.382947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:54.382947 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] PATH_INFO: `/v3/projects/37a78c0b8c764ce5ac41cf5d1d64e75b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:54.384923 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a78c0b8c764ce5ac41cf5d1d64e75b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:54.386894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:54.527111 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c2dd531bdd44348c6e69e66445b4a1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.542081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a78c0b8c764ce5ac41cf5d1d64e75b', 'request_id': 'req-11530765-25e5-4bdb-8b25-24d8c7fde26b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.549664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a78c0b8c764ce5ac41cf5d1d64e75b', 'request_id': 'req-11530765-25e5-4bdb-8b25-24d8c7fde26b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.601988 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c2dd531bdd44348c6e69e66445b4a1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.618618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c2dd531bdd44348c6e69e66445b4a1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.625835 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c2dd531bdd44348c6e69e66445b4a1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.626538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c2dd531bdd44348c6e69e66445b4a1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.632674 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1332/2662] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:54 2022] DELETE /identity/v3/users/68c2dd531bdd44348c6e69e66445b4a1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:54.633698 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:54.636151 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:54.688416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a78c0b8c764ce5ac41cf5d1d64e75b', 'request_id': 'req-11530765-25e5-4bdb-8b25-24d8c7fde26b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.708839 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] The token cache is being invalidate because project 37a78c0b8c764ce5ac41cf5d1d64e75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:54.709381 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.710324 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.717249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1331/2663] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:54 2022] DELETE /identity/v3/projects/37a78c0b8c764ce5ac41cf5d1d64e75b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:54.718955 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:54.721327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:54.722904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efbfdb-0e65-4238-bcb1-3b8a544e09da admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:54.729736 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:54.732035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:54.732035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:54.732035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] PATH_INFO: `/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:54.738009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c663e2c5d31d442c8e1035fdd2cbd969)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:54.740615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:54.822417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11530765-25e5-4bdb-8b25-24d8c7fde26b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:54.828188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:54.829711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:54.829992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:54.830466 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] PATH_INFO: `/v3/users/befdb8d231634e43899de51467d62502` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:54.831462 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=befdb8d231634e43899de51467d62502)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:54.833440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:54.913040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c663e2c5d31d442c8e1035fdd2cbd969', 'request_id': 'req-ce777a21-ea30-4d09-bdeb-9e171ac05808'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:54.918985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c663e2c5d31d442c8e1035fdd2cbd969', 'request_id': 'req-ce777a21-ea30-4d09-bdeb-9e171ac05808'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.076683 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c663e2c5d31d442c8e1035fdd2cbd969', 'request_id': 'req-ce777a21-ea30-4d09-bdeb-9e171ac05808'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.090785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] The token cache is being invalidate because project c663e2c5d31d442c8e1035fdd2cbd969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:55.091105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.091958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.093813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1333/2664] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:54 2022] DELETE /identity/v3/projects/c663e2c5d31d442c8e1035fdd2cbd969 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:55.097078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befdb8d231634e43899de51467d62502'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.241657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befdb8d231634e43899de51467d62502'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.258108 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befdb8d231634e43899de51467d62502'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.265948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befdb8d231634e43899de51467d62502'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.266741 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-91417e66-46e3-45e5-a952-76ed8cc45dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befdb8d231634e43899de51467d62502'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.274661 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:55.276953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1332/2665] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:54 2022] DELETE /identity/v3/users/befdb8d231634e43899de51467d62502 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:55.285986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:55.288079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:55.395196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce777a21-ea30-4d09-bdeb-9e171ac05808 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:55.450031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:55.450803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.450803 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.452528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] PATH_INFO: `/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.452528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89afc91810f6444cb6c4ba556dd7f6ca)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:55.454260 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:55.527444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:55.588804 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89afc91810f6444cb6c4ba556dd7f6ca', 'request_id': 'req-da9ba5d4-0460-43dc-bc71-b901eee6bc68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.594997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89afc91810f6444cb6c4ba556dd7f6ca', 'request_id': 'req-da9ba5d4-0460-43dc-bc71-b901eee6bc68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.664299 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89afc91810f6444cb6c4ba556dd7f6ca', 'request_id': 'req-da9ba5d4-0460-43dc-bc71-b901eee6bc68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.675722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] The token cache is being invalidate because project 89afc91810f6444cb6c4ba556dd7f6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:55.676268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.676914 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.678388 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1334/2666] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:55 2022] DELETE /identity/v3/projects/89afc91810f6444cb6c4ba556dd7f6ca => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:55.684360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa854f-1d2b-44d9-b0be-61f10a419987 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.684637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa854f-1d2b-44d9-b0be-61f10a419987 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.684904 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa854f-1d2b-44d9-b0be-61f10a419987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.704513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-39aa854f-1d2b-44d9-b0be-61f10a419987 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:55.705615 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-39aa854f-1d2b-44d9-b0be-61f10a419987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:55.748833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:55.751286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:55.765622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1333/2667] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:55.773813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.774093 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.774364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.795091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:55.796416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:55.805118 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1334/2668] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:55.809287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:55.818875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22f22e-8ba9-42b4-84de-7276aa0657e4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:55.820478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ba5d4-0460-43dc-bc71-b901eee6bc68 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:55.823746 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:55.824379 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.824717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.825055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.825202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:55.825824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.825924 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:55.826125 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.826308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:55.826416 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] PATH_INFO: `/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.827502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244f12b35c5e49d6b1d822a09f1cbf9b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:55.828051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:55.829409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:55.840354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1335/2669] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:55.844508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:55.854176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be24960-95be-4077-8c0a-95683764a615 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:55.859019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:55.862134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:55.862134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:55.862134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:55.862134 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:55.862775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:55.971816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244f12b35c5e49d6b1d822a09f1cbf9b', 'request_id': 'req-898d614c-53db-47c2-acf9-e117c1038ce3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.974139 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244f12b35c5e49d6b1d822a09f1cbf9b', 'request_id': 'req-898d614c-53db-47c2-acf9-e117c1038ce3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:55.975182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1336/2670] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:55 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:55.979319 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.040775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da5678-71a2-48fc-99bc-fd83a96c9401 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.045350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.046030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.046279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.046578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.047556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.050171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.078677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244f12b35c5e49d6b1d822a09f1cbf9b', 'request_id': 'req-898d614c-53db-47c2-acf9-e117c1038ce3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.090717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] The token cache is being invalidate because project 244f12b35c5e49d6b1d822a09f1cbf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:56.091171 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.091823 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-898d614c-53db-47c2-acf9-e117c1038ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.093349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1335/2671] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:55 2022] DELETE /identity/v3/projects/244f12b35c5e49d6b1d822a09f1cbf9b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:56.097995 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335781-6c5f-4ac6-a30d-5f30fff14b93 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.098383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335781-6c5f-4ac6-a30d-5f30fff14b93 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.098792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74335781-6c5f-4ac6-a30d-5f30fff14b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.118152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-74335781-6c5f-4ac6-a30d-5f30fff14b93 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:56.119379 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-74335781-6c5f-4ac6-a30d-5f30fff14b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.134690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1336/2672] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:56.139750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.140035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.140308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.153394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1337/2673] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:55 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:56.157406 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.159099 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.160805 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:56.161982 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.169938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1337/2674] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:56.171284 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24df5be-00ae-41a9-bc4f-fd59a24a8851 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.174337 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.177241 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.177846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.178127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.178398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.179076 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.180652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.183517 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704387f-4242-491c-bb4a-515f1f3500d7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.188612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.189842 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.190144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.190419 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.191096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:56.191391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1338/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:56.191530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.193029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.195352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.204918 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5820f-75f8-401f-ab5f-d3e0d4ef3cc5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.205089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1338/2676] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:09:56.209208 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.214743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.214743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.214743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.214743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.215188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.215791 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.219359 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153db5-843e-46ad-ab1e-e845e0897d7c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.224418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.224958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.225283 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.225562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.226202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.227581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1339/2677] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:56.228226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.231648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.242939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463320f-5ce8-4229-a8c6-2c75f7af3803 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.248454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.249110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.249388 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.249661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] PATH_INFO: `/v3/projects/74f7df25da9c4e87ab85e5269633c4ae/users/cb302ec36c7847249a414bd3486d6961/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.264948 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f7df25da9c4e87ab85e5269633c4ae, user_id=cb302ec36c7847249a414bd3486d6961, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.270345 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953281d-88c2-4222-bcb0-840736877ad9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.326295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1339/2678] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:56.327310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.351751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1340/2679] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:56 2022] PUT /identity/v3/projects/74f7df25da9c4e87ab85e5269633c4ae/users/cb302ec36c7847249a414bd3486d6961/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:56.364055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.364959 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.365273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.396728 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef404c4a-4419-4618-b364-4bb41cb54b7f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.398000 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] MFA Rules not processed for user `cb302ec36c7847249a414bd3486d6961`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:56.399322 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.453690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.454970 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.455312 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.455688 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.456320 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.458221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.464958 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:56.468886 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1341/2680] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:56.509748 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.511283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.561789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1340/2681] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:56.566413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.571468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590435d-c426-490c-8c55-c75a3a8bf6e9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.572673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.573273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.573546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.573818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.576291 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983dc01-b27b-453b-8086-759744392a79 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.581703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.582329 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.582642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.582806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.582932 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.583622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.584256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.585192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.592774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1342/2682] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:56.597720 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1341/2683] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:56.610781 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.610891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.610985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb1ad-092e-4095-8ea4-d5d44212fe19 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.615289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.615877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.616149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.616443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.617113 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.618466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74daa22-0ad7-41cc-a2ab-fd9b657d84e4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.618698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.623273 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.623888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.624167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.624441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] PATH_INFO: `/v3/users/cb302ec36c7847249a414bd3486d6961` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.625615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb302ec36c7847249a414bd3486d6961)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.628050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.630062 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1343/2684] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:56.635834 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.644655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:56.648449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a4936-a4e7-4486-bf93-350cbf460d93 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.653334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.654006 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.654282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.654597 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] PATH_INFO: `/v3/projects/fd2c1003639a410388563a7b8ef79855/users/5c7487e5c3264a97a00cfa1f8220fb8a/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.669360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2c1003639a410388563a7b8ef79855, user_id=5c7487e5c3264a97a00cfa1f8220fb8a, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.672019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a220-98e9-4a63-8ba2-63e50a782100 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.749579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1344/2685] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:56 2022] PUT /identity/v3/projects/fd2c1003639a410388563a7b8ef79855/users/5c7487e5c3264a97a00cfa1f8220fb8a/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:56.759986 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.760295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.760600 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.787235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] MFA Rules not processed for user `5c7487e5c3264a97a00cfa1f8220fb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:56.788431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:56.825740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb302ec36c7847249a414bd3486d6961'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.851826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1345/2686] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:56.856472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:56.912580 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb302ec36c7847249a414bd3486d6961'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.916824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32a500-86a5-4486-92d8-fbf7d4e667a8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:56.921537 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:56.922137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.922459 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.922790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.923940 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:56.925489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb302ec36c7847249a414bd3486d6961'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.925842 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:56.932361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb302ec36c7847249a414bd3486d6961'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.933037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-240476de-65f2-4dba-a30f-009b2eddfe18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb302ec36c7847249a414bd3486d6961'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:56.939509 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1342/2687] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:09:56 2022] DELETE /identity/v3/users/cb302ec36c7847249a414bd3486d6961 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:56.943903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:56.944185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:56.944454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:56.962655 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:56.963849 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.006070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1346/2688] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:57.010096 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.011823 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.022245 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1343/2689] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:57.031980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.033784 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.075731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9d774-6a59-47d9-8332-2bdea067c4bf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.080416 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.081012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.081288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.081561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.082171 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.084225 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.090228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4783e2-873c-4eca-9483-9991f598f580 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.137468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.138065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.138344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.138660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.148190 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.149711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.159538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1344/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:09:57.174177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1347/2691] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:57 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:09:57.178762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.180587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:57.191145 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf475-fed9-4be7-b644-daa67571f9d4 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.196491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.197201 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.197542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.198040 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.198820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.200963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.213657 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1345/2692] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:57.217784 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.230387 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2654-7953-4183-842a-91abe630bdba admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.236215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.236875 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.239553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.239553 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] PATH_INFO: `/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7/users/32b4a7e59c1d486ea0e887b9cc4b96e4/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.254852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fc647b77ec4076b8f7ed0efa09bed7, user_id=32b4a7e59c1d486ea0e887b9cc4b96e4, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.261885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.316292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:57.353295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1348/2693] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:57 2022] PUT /identity/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7/users/32b4a7e59c1d486ea0e887b9cc4b96e4/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:57.354445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.365067 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0be0-c545-4d60-b8e4-2391ac916a76 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.424285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.425109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.425437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.426173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.427002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.428781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c25bc-22d8-434d-bb13-dbe3d8214856 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.441539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1346/2694] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:09:57.445911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.459164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7869c-e4b4-40e5-91ad-9267bed5a1d7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.472658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.473386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.473723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.474002 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] PATH_INFO: `/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7/users/32b4a7e59c1d486ea0e887b9cc4b96e4/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.476144 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fc647b77ec4076b8f7ed0efa09bed7, user_id=32b4a7e59c1d486ea0e887b9cc4b96e4, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.478937 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.490160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1349/2695] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:57 2022] PUT /identity/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7/users/32b4a7e59c1d486ea0e887b9cc4b96e4/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:57.500510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.500795 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.501071 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.531410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] MFA Rules not processed for user `32b4a7e59c1d486ea0e887b9cc4b96e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:57.531410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.600247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1347/2696] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:57.611601 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.616759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.673178 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7a06-147e-455b-99a9-502f115eb4bb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.680209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:57.680380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.680695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.680971 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.681196 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.681837 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:57.692127 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.693922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cc994-00c8-4389-8263-7b5724021932 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.704066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1350/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:57.750458 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e1b59-0780-4bad-9b65-023e66caa165 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:57.755220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:57.755867 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:57.756144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:57.756414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] PATH_INFO: `/v3/projects/74f7df25da9c4e87ab85e5269633c4ae` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:57.757538 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f7df25da9c4e87ab85e5269633c4ae)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:57.759445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:57.824433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:57.924435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f7df25da9c4e87ab85e5269633c4ae', 'request_id': 'req-4c361745-d5db-4f00-9b4e-1867b4763811'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:57.931430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f7df25da9c4e87ab85e5269633c4ae', 'request_id': 'req-4c361745-d5db-4f00-9b4e-1867b4763811'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:58.015856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f7df25da9c4e87ab85e5269633c4ae', 'request_id': 'req-4c361745-d5db-4f00-9b4e-1867b4763811'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:58.027047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] The token cache is being invalidate because project 74f7df25da9c4e87ab85e5269633c4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:09:58.027336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:58.028007 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4c361745-d5db-4f00-9b4e-1867b4763811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:09:58.029536 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1348/2698] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:09:57 2022] DELETE /identity/v3/projects/74f7df25da9c4e87ab85e5269633c4ae => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:09:58.034897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.035180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.035449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.055143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:58.056329 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:58.096631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:58.117694 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1351/2699] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:09:58.183221 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.183507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.183781 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.204018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:58.205899 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:58.214078 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1349/2700] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:58.218307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.227925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82728a43-19af-42d6-9d55-c94a21f01ee1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.232428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.233160 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.233328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.233595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.234237 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:09:58.234627 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.236261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.247499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1352/2701] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:09:58.252417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.261516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e69b7-f3ba-4399-8a70-8fac83372d9b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.266138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.267525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.267801 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.268070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.268739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.270670 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.357133 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1350/2702] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:58.358369 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.368691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3e22-cf1f-4cf1-97a1-c89878d8114b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.431251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.431864 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.432142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.432413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.433044 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.435140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.467208 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:58.544483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1353/2703] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:09:58 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:09:58.545719 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.556520 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da414-dee9-48f0-9072-df36d16830a0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.561196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.568539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.568539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.568539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.568539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.568539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.577765 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1351/2704] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:58.579202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.587432 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:58.590224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ef9d3-0a1a-45c8-89f4-56ac3ed280c6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.595753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.596349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.596628 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.596898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.597540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.599238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c4b4f-804c-4ad1-bc52-9d85778664c6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.609818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1354/2705] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:09:58.614050 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.623928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52c19d-5156-4f48-b340-0d3ffb29b5fd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.628619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.629601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.629601 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.629786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] PATH_INFO: `/v3/projects/2ba02b910e564332976e83e6fd494ea0/users/6ef253a291e443ad9eb8af2cda15ce33/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.646230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba02b910e564332976e83e6fd494ea0, user_id=6ef253a291e443ad9eb8af2cda15ce33, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.648887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.728460 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1352/2706] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:09:58 2022] PUT /identity/v3/projects/2ba02b910e564332976e83e6fd494ea0/users/6ef253a291e443ad9eb8af2cda15ce33/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:09:58.745670 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.746207 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.746307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.775059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] MFA Rules not processed for user `6ef253a291e443ad9eb8af2cda15ce33`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:09:58.776278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:58.841663 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1355/2707] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:09:58.858693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:09:58.860444 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:09:58.864766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:58.920366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb61fb-db11-4521-82eb-c17535d3ebcd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:09:58.924540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:09:58.925142 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:09:58.925417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:09:58.925686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:09:58.934117 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:09:58.935606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:09:58.944596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1353/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:09:59.050583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:59.558407 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:09:59.686746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:00.089191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:00.090872 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:00.209739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b16f5-9388-44ac-a33b-7c8174097da7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:00.217562 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:00.222635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:00.222635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:00.222635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:00.222635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:00.236457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:00.243787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73e62d-9768-4e10-be1e-c2bbad804ac9 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:00.260014 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1356/2709] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:00.819034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:00.820699 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:00.896925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb36a7-93f6-4fa5-94f0-7a09b5c1ac63 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:00.901513 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:00.902306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:00.902695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:00.909029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] PATH_INFO: `/v3/users/5c7487e5c3264a97a00cfa1f8220fb8a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:00.909029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7487e5c3264a97a00cfa1f8220fb8a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:00.909029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:01.094493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7487e5c3264a97a00cfa1f8220fb8a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:01.169642 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7487e5c3264a97a00cfa1f8220fb8a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:01.185254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7487e5c3264a97a00cfa1f8220fb8a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:01.192355 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7487e5c3264a97a00cfa1f8220fb8a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:01.193105 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7487e5c3264a97a00cfa1f8220fb8a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:01.199456 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1354/2710] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:00 2022] DELETE /identity/v3/users/5c7487e5c3264a97a00cfa1f8220fb8a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:01.204086 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:01.204608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:01.204697 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:01.225820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:01.227192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:01.290810 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1357/2711] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:01.304310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:01.305718 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:01.365119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e00b7-b4e8-4f7c-9556-10881400531d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:01.368747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:01.369354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:01.369632 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:01.369905 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:01.380354 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:01.381749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:01.392295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1355/2712] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:01.859902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:01.861458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:01.873675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f2f6-23a0-4994-aeec-a6203c2e711a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:01.881950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:01.882888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:01.883098 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:01.883423 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] PATH_INFO: `/v3/projects/fd2c1003639a410388563a7b8ef79855` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:01.884574 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2c1003639a410388563a7b8ef79855)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:01.886821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:01.888596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:02.025862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2c1003639a410388563a7b8ef79855', 'request_id': 'req-8a663db1-f534-47bf-a80a-f5ea445e115e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.032413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2c1003639a410388563a7b8ef79855', 'request_id': 'req-8a663db1-f534-47bf-a80a-f5ea445e115e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.176666 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2c1003639a410388563a7b8ef79855', 'request_id': 'req-8a663db1-f534-47bf-a80a-f5ea445e115e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.189327 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] The token cache is being invalidate because project fd2c1003639a410388563a7b8ef79855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:02.189611 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.190336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.192129 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1358/2713] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:01 2022] DELETE /identity/v3/projects/fd2c1003639a410388563a7b8ef79855 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:02.198603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:02.208573 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033890-da10-4ac5-9d15-417204397e03 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:02.221173 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:02.265307 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:02.265928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:02.266210 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:02.266484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] PATH_INFO: `/v3/users/32b4a7e59c1d486ea0e887b9cc4b96e4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:02.267648 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b4a7e59c1d486ea0e887b9cc4b96e4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:02.269543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:02.463584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b4a7e59c1d486ea0e887b9cc4b96e4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.561807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b4a7e59c1d486ea0e887b9cc4b96e4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.577553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b4a7e59c1d486ea0e887b9cc4b96e4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.585274 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b4a7e59c1d486ea0e887b9cc4b96e4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.590360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-ea7aee61-a089-4d8c-bb05-3e41bcf8e776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b4a7e59c1d486ea0e887b9cc4b96e4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:02.596737 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1356/2714] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:02 2022] DELETE /identity/v3/users/32b4a7e59c1d486ea0e887b9cc4b96e4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:03.069192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.071527 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:03.084865 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a663db1-f534-47bf-a80a-f5ea445e115e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.142631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.143267 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.143548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.143820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] PATH_INFO: `/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.144933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fc647b77ec4076b8f7ed0efa09bed7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.146898 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.243675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fc647b77ec4076b8f7ed0efa09bed7', 'request_id': 'req-a820bf6b-1cc6-4b24-bce0-da3bff51d346'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:03.251036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fc647b77ec4076b8f7ed0efa09bed7', 'request_id': 'req-a820bf6b-1cc6-4b24-bce0-da3bff51d346'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:03.329411 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fc647b77ec4076b8f7ed0efa09bed7', 'request_id': 'req-a820bf6b-1cc6-4b24-bce0-da3bff51d346'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:03.341223 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] The token cache is being invalidate because project 45fc647b77ec4076b8f7ed0efa09bed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:03.341513 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:03.342161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a820bf6b-1cc6-4b24-bce0-da3bff51d346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:03.343876 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1359/2715] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:03 2022] DELETE /identity/v3/projects/45fc647b77ec4076b8f7ed0efa09bed7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:03.349368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.349878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.350000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.370376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:03.371631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:03.430057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1357/2716] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:03.438004 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.438289 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.438608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.469056 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:03.470448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:03.479845 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1360/2717] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:03.484318 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.494641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859bb21-281d-4365-bede-bedcc10b8a04 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.499673 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.500344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.500685 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.501054 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.501808 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:03.502242 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.504644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.520963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1358/2718] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:10:03.524725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.537935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1de1ec-e314-4743-8cb1-30f0f304eaa4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.541826 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.542664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.543119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.543556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.544330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.546768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.561321 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:03.645297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1361/2719] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:03 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:03.649455 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.659557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15116-8741-48af-b9c2-406136c8077b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.681964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:03.721824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.721824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.721824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.721824 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.722197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.723748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.809768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1359/2720] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:03 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:03.813828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.824145 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-c7dd-4395-9b9f-af39675193a3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.828731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.829424 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.829698 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.829968 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.830786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.832976 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.843103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1362/2721] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:03.847650 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.858075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814c17-9e9f-4ece-810f-9b66ba5aa9f1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.865875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.866474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.866790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.867059 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.867987 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.869625 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724cc15-37a3-4588-a7fd-96b41d2271c5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:03.889677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1360/2722] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:03.890027 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:03.896498 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938347e-ebbb-491e-98f8-4d4b30d5d843 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:03.901244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:03.901879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:03.902155 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:03.902426 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] PATH_INFO: `/v3/projects/4f6b9eebe68a4f55b399f61bf529e913/users/ec985b0341334390851fb76a04182b68/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:03.918896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6b9eebe68a4f55b399f61bf529e913, user_id=ec985b0341334390851fb76a04182b68, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:03.921578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:04.062717 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1363/2723] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:03 2022] PUT /identity/v3/projects/4f6b9eebe68a4f55b399f61bf529e913/users/ec985b0341334390851fb76a04182b68/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:04.064721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.065070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:04.065980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:04.096494 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] MFA Rules not processed for user `ec985b0341334390851fb76a04182b68`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:04.098468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:04.161237 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1361/2724] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:04.165942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:04.229182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9977148-40e8-4450-95fe-8698404b5884 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:04.233965 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:04.234596 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.234881 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:04.235163 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:04.235832 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:04.238419 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:04.360674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1364/2725] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:04 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:04.365099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:04.376253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42786e-8160-478b-a6ac-ad7a86dea696 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:04.455132 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:04.456512 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.456810 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:04.457155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:04.462609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:04.462609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:04.680081 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1362/2726] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:04 2022] POST /identity/v3/users => generated 303 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:04.719800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:04.732579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9edc-722d-400f-ae1c-a77e39531b96 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:04.739828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:04.740564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.740954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:04.741313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:04.742054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:04.743934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:04.755977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1365/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:04.760032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:04.770886 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd237bf-25bf-4684-a065-e1941b515028 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:04.775838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:04.776730 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.777008 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:04.777295 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] PATH_INFO: `/v3/projects/ff7ae6014ad6476493640dfa4f10be69/users/c8b5fdd484414a47934a1c9306265579/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:04.796672 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7ae6014ad6476493640dfa4f10be69, user_id=c8b5fdd484414a47934a1c9306265579, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:04.799556 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:04.896819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1363/2728] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:04 2022] PUT /identity/v3/projects/ff7ae6014ad6476493640dfa4f10be69/users/c8b5fdd484414a47934a1c9306265579/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:04.903745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:04.926928 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9187de-9e90-4d54-b3e9-6dc39639e661 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:04.956228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:04.999102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:04.999711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:04.999989 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:05.000262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:05.000909 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:05.002652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87832be9-048d-40f8-9197-e194712ae702 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:05.013058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1366/2729] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:05.017001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:05.027542 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac3788-ff7d-4a86-baab-e5638f1b9741 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:05.032340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:05.032993 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:05.033268 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:05.033537 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] PATH_INFO: `/v3/projects/ff7ae6014ad6476493640dfa4f10be69/users/c8b5fdd484414a47934a1c9306265579/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:05.035997 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7ae6014ad6476493640dfa4f10be69, user_id=c8b5fdd484414a47934a1c9306265579, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:05.038584 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:05.048797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1364/2730] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:05 2022] PUT /identity/v3/projects/ff7ae6014ad6476493640dfa4f10be69/users/c8b5fdd484414a47934a1c9306265579/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:05.060779 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:05.061066 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:05.061339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:05.090892 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] MFA Rules not processed for user `c8b5fdd484414a47934a1c9306265579`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:05.092143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:05.106344 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:05.163475 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1367/2731] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:05.194829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:05.194829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:05.249019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7161b73-966d-4c9d-a918-ba4de4cee127 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:05.252576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:05.256373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:05.256373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:05.256373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:05.262743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:05.264155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4287f2-aa17-46e7-91b7-fc9d1b1ff205 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:05.273915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1365/2732] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:05.340643 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:05.356497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c420e-f30a-41ea-9d7a-695d100dd579 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:05.356497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:05.356497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:05.356497 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:05.356907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:05.413673 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:05.415191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:05.424227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1368/2733] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:06.376070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:06.376607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:06.376607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:06.396136 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] MFA Rules not processed for user `9d7a0aeef047474894c4e16edfe1f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:06.397574 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:06.466172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1366/2734] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:09.812354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:09.822654 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c9e3-b4a8-48df-bdf6-801b5f4aab8e service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:09.827012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:09.827891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:09.828348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:09.828785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:09.830877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:09.898700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:09.900249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:09.910013 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1369/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:10.458948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:10.531543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9ac47-db14-4ac8-8fe7-7267b4468ca2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:10.536851 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:10.537649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:10.537902 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:10.538562 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] PATH_INFO: `/v3/users/ec985b0341334390851fb76a04182b68` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:10.539821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec985b0341334390851fb76a04182b68)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:10.541721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:10.685675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:10.687579 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:10.701847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88080f4-405f-4c32-ae8e-ac89ac0ea714 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:10.711939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:10.711939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:10.711939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:10.711939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] PATH_INFO: `/v3/users/6ef253a291e443ad9eb8af2cda15ce33` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:10.712336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef253a291e443ad9eb8af2cda15ce33)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:10.712336 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:10.732363 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:10.741298 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec985b0341334390851fb76a04182b68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.816014 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec985b0341334390851fb76a04182b68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.842112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec985b0341334390851fb76a04182b68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.852603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec985b0341334390851fb76a04182b68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.853745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-996e11a7-9e75-4493-aca8-5fd69f96aef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec985b0341334390851fb76a04182b68'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.856526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:10.866328 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1367/2736] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:10 2022] DELETE /identity/v3/users/ec985b0341334390851fb76a04182b68 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:10.868167 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:10.868411 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:10.868693 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:10.870051 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef253a291e443ad9eb8af2cda15ce33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.890839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:10.892262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:10.935838 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef253a291e443ad9eb8af2cda15ce33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.951427 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef253a291e443ad9eb8af2cda15ce33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.959354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef253a291e443ad9eb8af2cda15ce33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.960175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cdc2267c-849e-4106-ac9e-aae57e87ac35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef253a291e443ad9eb8af2cda15ce33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:10.968765 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1370/2737] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:10 2022] DELETE /identity/v3/users/6ef253a291e443ad9eb8af2cda15ce33 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:10.973539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1368/2738] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:10.974679 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:10.974983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:10.975256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:10.988276 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:10.989671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:10.996176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:10.997483 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:11.064676 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1371/2739] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:11.076853 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059d1e3-7731-4a59-ab50-5b9e5f696e82 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:11.084688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:11.084688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:11.133754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:11.134373 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:11.134731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:11.135079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:11.149018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:11.150493 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:11.151814 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91275c54-34fb-4eb8-94a2-0dcceb94d2ef None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:11.155920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:11.156751 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:11.157046 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:11.157349 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:11.163833 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1369/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:11.167710 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:11.169210 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:11.180177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1372/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:10:11.719891 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:11.722750 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:11.735848 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb74693-2537-4fc8-8fd2-e71953f481d2 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:11.743147 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:11.744033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:11.744491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:11.744763 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] PATH_INFO: `/v3/projects/2ba02b910e564332976e83e6fd494ea0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:11.747032 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba02b910e564332976e83e6fd494ea0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:11.759030 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:11.760829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:11.760984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:11.762248 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:11.780069 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50d5b3-e680-48a1-8389-f5a57c316abd service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:11.785952 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:11.791561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:11.791561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:11.791561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] PATH_INFO: `/v3/projects/4f6b9eebe68a4f55b399f61bf529e913` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:11.791561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6b9eebe68a4f55b399f61bf529e913)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:11.791561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:11.935184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba02b910e564332976e83e6fd494ea0', 'request_id': 'req-0337752e-d567-4b2e-bef7-da4f99a56b95'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:11.941382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba02b910e564332976e83e6fd494ea0', 'request_id': 'req-0337752e-d567-4b2e-bef7-da4f99a56b95'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:11.967072 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6b9eebe68a4f55b399f61bf529e913', 'request_id': 'req-fd82b053-db42-4ef7-9d6e-d612ca3047ef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:11.973705 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6b9eebe68a4f55b399f61bf529e913', 'request_id': 'req-fd82b053-db42-4ef7-9d6e-d612ca3047ef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:11.975394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:12.015254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba02b910e564332976e83e6fd494ea0', 'request_id': 'req-0337752e-d567-4b2e-bef7-da4f99a56b95'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.026785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] The token cache is being invalidate because project 2ba02b910e564332976e83e6fd494ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:12.027070 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.027695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0337752e-d567-4b2e-bef7-da4f99a56b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.029205 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1370/2742] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:11 2022] DELETE /identity/v3/projects/2ba02b910e564332976e83e6fd494ea0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:12.034002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f270-398e-4f9b-a843-e9202f5ac005 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.034310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f270-398e-4f9b-a843-e9202f5ac005 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.034622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146f270-398e-4f9b-a843-e9202f5ac005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.055001 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9146f270-398e-4f9b-a843-e9202f5ac005 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:12.056192 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9146f270-398e-4f9b-a843-e9202f5ac005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.113317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1371/2743] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:12.122187 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.122468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.122766 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.130841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6b9eebe68a4f55b399f61bf529e913', 'request_id': 'req-fd82b053-db42-4ef7-9d6e-d612ca3047ef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.143756 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] The token cache is being invalidate because project 4f6b9eebe68a4f55b399f61bf529e913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:12.144043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.144693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.144809 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:12.145937 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.146292 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1373/2744] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:11 2022] DELETE /identity/v3/projects/4f6b9eebe68a4f55b399f61bf529e913 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:12.150161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.151457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.156748 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1372/2745] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:12.162786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.165326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82b053-db42-4ef7-9d6e-d612ca3047ef admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.170060 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.170736 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.171011 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.171297 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] PATH_INFO: `/v3/users/c8b5fdd484414a47934a1c9306265579` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.171563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17796-3ca0-4f8d-906d-c0cb4eed6165 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.172414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b5fdd484414a47934a1c9306265579)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.174294 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.177178 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.177761 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.178034 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.178415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.179635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:12.179942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.181508 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.197141 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1373/2746] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:10:12.198089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.207986 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60523-58a3-4a3b-8b76-940ee64de2bf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.212474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.213047 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.213321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.213595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.214198 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.216088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.281480 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1374/2747] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:12.285558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.329863 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b5fdd484414a47934a1c9306265579'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.347471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529c348-f58c-49fc-9b77-b4b67ae7ec7e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.352558 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.353156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.353429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.353940 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.354598 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.356534 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.395467 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b5fdd484414a47934a1c9306265579'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.407926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b5fdd484414a47934a1c9306265579'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.415220 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b5fdd484414a47934a1c9306265579'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.416058 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b5fdd484414a47934a1c9306265579'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:12.421855 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1374/2748] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:12 2022] DELETE /identity/v3/users/c8b5fdd484414a47934a1c9306265579 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:12.442789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1375/2749] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:12 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:12.445542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.446977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.514187 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1960b1-3d90-43df-b945-14feec850aa1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.519100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.519712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.519994 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.520268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.520920 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.522544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.533081 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1375/2750] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:10:12.536516 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:12.537772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.548722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21377c-ce59-4454-a8e6-9e681cb615f8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.554546 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.555156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.555506 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.555739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.556383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.558062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a5f32-45eb-42dd-9e13-317457b269d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.568869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1376/2751] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:10:12.573560 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.584934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1bbef-fd15-4975-86e2-4b8bbe43337c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.589831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.592247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.592247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.592247 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] PATH_INFO: `/v3/projects/33967608284a412bb80590a25b69fb66/users/e2c0bfd297da4597a8a9cef47d41e742/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.607985 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33967608284a412bb80590a25b69fb66, user_id=e2c0bfd297da4597a8a9cef47d41e742, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.610821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.698122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1376/2752] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:12 2022] PUT /identity/v3/projects/33967608284a412bb80590a25b69fb66/users/e2c0bfd297da4597a8a9cef47d41e742/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:12.709080 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.709367 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.709644 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.755984 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] MFA Rules not processed for user `e2c0bfd297da4597a8a9cef47d41e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:12.760561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.826793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1377/2753] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:12.837759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.839445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.871987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:12.898356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:12.899466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:12.899613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a4314-d5f6-4197-9809-59bde6bf1214 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.903304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.903913 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.904191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:12.904464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:12.913941 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:12.915835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee019f61-f137-4ed1-a51c-575f9ac0f8cc service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:12.958408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1377/2754] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:12.992813 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454a07d-6491-487d-8ce3-ecd950d0bda9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:12.998457 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:12.999396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:12.999731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.000077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] PATH_INFO: `/v3/projects/ff7ae6014ad6476493640dfa4f10be69` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.001349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7ae6014ad6476493640dfa4f10be69)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.003402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.134101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7ae6014ad6476493640dfa4f10be69', 'request_id': 'req-16428847-1444-4cd4-a19b-1493e2201f0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:13.141011 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7ae6014ad6476493640dfa4f10be69', 'request_id': 'req-16428847-1444-4cd4-a19b-1493e2201f0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:13.215755 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7ae6014ad6476493640dfa4f10be69', 'request_id': 'req-16428847-1444-4cd4-a19b-1493e2201f0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:13.219757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:13.232092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] The token cache is being invalidate because project ff7ae6014ad6476493640dfa4f10be69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:13.232409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:13.233144 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-16428847-1444-4cd4-a19b-1493e2201f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:13.235177 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1378/2755] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:12 2022] DELETE /identity/v3/projects/ff7ae6014ad6476493640dfa4f10be69 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:13.243109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.243109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.243109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.265731 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:13.267177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:13.336273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1378/2756] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:13.344497 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.344703 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.345183 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.368721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:13.369926 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:13.378445 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1379/2757] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:13.383036 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.392809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bbcc0-a415-4e02-8cb3-7d278f732d49 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.397685 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.398270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.398581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.398860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.399551 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:13.399856 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.401451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.412997 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1379/2758] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:10:13.417249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.427214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73df27-147a-431a-87a8-be6a9a03694f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.431976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.432597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.432873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.433143 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.433773 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.435874 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.571628 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1380/2759] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:13.575840 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.594819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb746b7-1a91-4501-b93c-77e24af9b941 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.656921 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.657535 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.657816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.658089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.658769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.660787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.735315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1380/2760] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:13 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:13.740029 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.750462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680f394-1207-4234-b004-270fcc73a535 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.755315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.758289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.758289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.758289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.758289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.759135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.771317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1381/2761] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:13.775312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.786485 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adbc2-06d2-4981-b66c-d07e246d45dd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.791318 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.791987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.792263 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.792548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.793167 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.794888 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5182c9-89bd-486c-9542-0907d7b7cc44 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.807110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1381/2762] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:13.811326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:13.822396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca0c99-c09d-4e65-afd7-e0dd26e16618 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:13.827471 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:13.829408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.829408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.829408 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] PATH_INFO: `/v3/projects/a807c834d5d94141ba1409eaa1794b0b/users/c0e0c42e61e24c96a853e8d3d284656b/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:13.844244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a807c834d5d94141ba1409eaa1794b0b, user_id=c0e0c42e61e24c96a853e8d3d284656b, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:13.847418 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:13.963544 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1382/2763] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:13 2022] PUT /identity/v3/projects/a807c834d5d94141ba1409eaa1794b0b/users/c0e0c42e61e24c96a853e8d3d284656b/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:13.973768 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:13.974053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:13.984514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.002222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] MFA Rules not processed for user `c0e0c42e61e24c96a853e8d3d284656b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:14.003999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:14.035003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:14.082393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1382/2764] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:14.087072 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.151606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba09-4458-42cf-94d4-9b95bd4b6ef7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.156366 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.156973 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.157247 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.157515 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.158253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.160335 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.280286 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1383/2765] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:14.281571 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.292487 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8232d0-701f-42dd-9898-502e7f0e6ea4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.349447 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.350055 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.350330 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.350633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.351257 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.353162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.453288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1383/2766] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:14 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:14.454492 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.466309 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9995-ab8a-4258-a7e1-3977a5785755 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.472597 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.474396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.474396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.474396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.474396 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.475619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.486433 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1384/2767] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:14.490657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.500667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d44dc5-7a2e-422b-9469-6280076bdb49 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.506184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.506887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.507191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.507458 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] PATH_INFO: `/v3/projects/e3eba6193f604ead9a517d4dc6800de1/users/5df67cbbc9c641f7bcb6451f7d7f13e8/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.523774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3eba6193f604ead9a517d4dc6800de1, user_id=5df67cbbc9c641f7bcb6451f7d7f13e8, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.526990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.606268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1384/2768] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:14 2022] PUT /identity/v3/projects/e3eba6193f604ead9a517d4dc6800de1/users/5df67cbbc9c641f7bcb6451f7d7f13e8/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:14.610184 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.620238 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa167a-8339-44f1-8ff1-26f28b761aed admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.675362 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.676230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.676503 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.676768 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.677395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.678983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394ea4d-cd6b-4a2e-b687-d6da1c323f23 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.681107 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:14.689374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1385/2769] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:14.693894 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.704246 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba30f8-f011-4f9f-a6f9-9b56d0458946 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.709492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.712767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.712767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.712767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] PATH_INFO: `/v3/projects/e3eba6193f604ead9a517d4dc6800de1/users/5df67cbbc9c641f7bcb6451f7d7f13e8/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.712767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3eba6193f604ead9a517d4dc6800de1, user_id=5df67cbbc9c641f7bcb6451f7d7f13e8, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.715235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4c426-c6dd-4fcf-905a-cd2ece0513d6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.715429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.715715 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.715991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.725675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1385/2770] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:14 2022] PUT /identity/v3/projects/e3eba6193f604ead9a517d4dc6800de1/users/5df67cbbc9c641f7bcb6451f7d7f13e8/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:14.735180 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] MFA Rules not processed for user `e2c0bfd297da4597a8a9cef47d41e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:14.736123 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:14.736521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.736806 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.737075 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.765472 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] MFA Rules not processed for user `5df67cbbc9c641f7bcb6451f7d7f13e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:14.767175 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:14.794368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1386/2771] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:14.839572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1386/2772] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:14.850350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:14.851762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:14.916964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c9f06-a888-45af-98c1-8670d4704c16 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:14.920724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:14.921330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:14.921612 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:14.921887 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:14.932262 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:14.933677 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef39491-2963-403e-9a07-78c3f42e2da8 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:14.944319 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1387/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:15.107141 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:15.111456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:15.171124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3fb1f-9fec-4627-a42f-735ac7898316 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:15.177671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:15.178347 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:15.179092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:15.179092 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] PATH_INFO: `/v3/users/c0e0c42e61e24c96a853e8d3d284656b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:15.180249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e0c42e61e24c96a853e8d3d284656b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:15.182425 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:15.440954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e0c42e61e24c96a853e8d3d284656b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:15.509773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e0c42e61e24c96a853e8d3d284656b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:15.527162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e0c42e61e24c96a853e8d3d284656b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:15.534540 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e0c42e61e24c96a853e8d3d284656b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:15.535278 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e0c42e61e24c96a853e8d3d284656b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:15.541563 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1387/2774] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:15 2022] DELETE /identity/v3/users/c0e0c42e61e24c96a853e8d3d284656b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:15.545942 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:15.546487 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:15.546740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:15.566249 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:15.567481 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:15.626751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1388/2775] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:15.637283 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:15.638734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:15.696311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6e8d5-00e6-4282-8642-9977f7bbfa9f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:15.699896 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:15.700489 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:15.700766 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:15.701037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:15.710660 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:15.712375 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:15.724325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1388/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:16.156591 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:16.159279 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:16.179928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d10361-133f-4e1f-95aa-b2c7d5ad3fe7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:16.187098 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:16.187749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:16.188031 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:16.189321 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] PATH_INFO: `/v3/projects/a807c834d5d94141ba1409eaa1794b0b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:16.189437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a807c834d5d94141ba1409eaa1794b0b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:16.191472 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:16.310924 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:16.317374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a807c834d5d94141ba1409eaa1794b0b', 'request_id': 'req-b3257a95-19ea-48a7-8d0e-5ef185f2829c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.324220 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a807c834d5d94141ba1409eaa1794b0b', 'request_id': 'req-b3257a95-19ea-48a7-8d0e-5ef185f2829c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.444869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a807c834d5d94141ba1409eaa1794b0b', 'request_id': 'req-b3257a95-19ea-48a7-8d0e-5ef185f2829c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.457875 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] The token cache is being invalidate because project a807c834d5d94141ba1409eaa1794b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:16.458203 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.458888 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.461304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1389/2777] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:16 2022] DELETE /identity/v3/projects/a807c834d5d94141ba1409eaa1794b0b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:16.465592 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:16.475887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19cbd-a1d3-4322-9a04-328f93750389 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:16.497688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:16.534503 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:16.535183 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:16.535464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:16.535739 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] PATH_INFO: `/v3/users/5df67cbbc9c641f7bcb6451f7d7f13e8` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:16.537020 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df67cbbc9c641f7bcb6451f7d7f13e8)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:16.538929 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:16.810110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df67cbbc9c641f7bcb6451f7d7f13e8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.892061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df67cbbc9c641f7bcb6451f7d7f13e8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.905143 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df67cbbc9c641f7bcb6451f7d7f13e8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.913334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df67cbbc9c641f7bcb6451f7d7f13e8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.914034 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-70b8e20e-eaf3-406c-80b4-ed157f724f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df67cbbc9c641f7bcb6451f7d7f13e8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:16.920053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1389/2778] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:16 2022] DELETE /identity/v3/users/5df67cbbc9c641f7bcb6451f7d7f13e8 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:17.353640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:17.355159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:17.369244 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257a95-19ea-48a7-8d0e-5ef185f2829c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:17.431101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:17.431734 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:17.432009 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:17.432303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] PATH_INFO: `/v3/projects/e3eba6193f604ead9a517d4dc6800de1` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:17.433415 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3eba6193f604ead9a517d4dc6800de1)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:17.435326 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:17.558852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3eba6193f604ead9a517d4dc6800de1', 'request_id': 'req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:17.565969 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3eba6193f604ead9a517d4dc6800de1', 'request_id': 'req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:17.661005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3eba6193f604ead9a517d4dc6800de1', 'request_id': 'req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:17.680690 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] The token cache is being invalidate because project e3eba6193f604ead9a517d4dc6800de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:17.681138 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:17.681923 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-85a8e0f4-822c-4c88-b930-dc4bdd9844cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:17.683585 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1390/2779] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:17 2022] DELETE /identity/v3/projects/e3eba6193f604ead9a517d4dc6800de1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:17.688606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:17.689107 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:17.689251 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:17.712418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:17.713624 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:17.799671 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1390/2780] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:17.804154 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:17.804458 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:17.806306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:17.832306 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:17.835104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:17.842708 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1391/2781] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:17.846359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:17.857970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda4a04-1215-4ec8-9ffa-bad452095b30 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:17.863960 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:17.864933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:17.865315 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:17.865675 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:17.866342 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:17.866681 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:17.868358 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:17.880569 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1391/2782] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:10:17.885097 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:17.895530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ecba-e125-4849-82cc-943c28387b6f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:17.900413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:17.901033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:17.901315 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:17.901727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:17.902371 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:17.904376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.064495 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1392/2783] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:17 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:18.069417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:18.079559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e0761-bf97-4c40-b927-17af405f6427 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:18.120942 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:18.157879 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:18.158499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.158792 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.159061 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.159716 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:18.162572 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.252693 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1392/2784] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:18 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:18.256825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:18.268088 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900994-0b00-43d7-872d-770fd279717e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:18.272782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:18.273360 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.273691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.273963 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.274643 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:18.276199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.286700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1393/2785] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:18.290492 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:18.301218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1bb49-a213-4d12-ab3d-85679f034205 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:18.305804 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:18.306400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.306743 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.306987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.307633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:18.309667 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa013a5-483f-408b-aab9-3b2fd18107a4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.319300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1393/2786] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:18.323436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:18.333431 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dadd0-c9eb-42b6-898b-be04ba8b28db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:18.338451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:18.339397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.339659 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.339929 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] PATH_INFO: `/v3/projects/0e3381082d0846a693b226cec98e43f4/users/f256492ca9c34838b092a244aa640579/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.361865 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3381082d0846a693b226cec98e43f4, user_id=f256492ca9c34838b092a244aa640579, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:18.366000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.369599 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:18.502704 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1394/2787] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:18 2022] PUT /identity/v3/projects/0e3381082d0846a693b226cec98e43f4/users/f256492ca9c34838b092a244aa640579/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:18.507847 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e77e7-cf84-4fe7-b3db-e3bc69031634 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.508135 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e77e7-cf84-4fe7-b3db-e3bc69031634 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.508414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e77e7-cf84-4fe7-b3db-e3bc69031634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.559790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-299e77e7-cf84-4fe7-b3db-e3bc69031634 None None] MFA Rules not processed for user `f256492ca9c34838b092a244aa640579`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:18.561190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-299e77e7-cf84-4fe7-b3db-e3bc69031634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:18.637192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1394/2788] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:18.648528 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:18.650272 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:18.715290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3590c-66e3-43b9-91a8-6c4e759913e9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:18.718919 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:18.719522 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:18.719796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:18.720065 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:18.728401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:18.729811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:18.739265 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1395/2789] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:25.600688 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e069c-6f07-42ee-b091-83cdefdcfb0a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:25.601199 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e069c-6f07-42ee-b091-83cdefdcfb0a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:25.601300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e069c-6f07-42ee-b091-83cdefdcfb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:25.623444 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3d4e069c-6f07-42ee-b091-83cdefdcfb0a None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:25.624703 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d4e069c-6f07-42ee-b091-83cdefdcfb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:25.693465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1395/2790] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:25.716430 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:25.717831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:25.793904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375aa4-809f-49e9-8ab9-8731aec91b02 service glance] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:25.799350 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:25.799954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:25.800234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:25.800505 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:25.809232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:25.810860 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:25.820060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1396/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:30.192796 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb80cf-9c28-4506-9700-639493ba9ad3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:30.193296 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb80cf-9c28-4506-9700-639493ba9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:30.193583 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb80cf-9c28-4506-9700-639493ba9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:30.266576 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:30.304218 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1aeb80cf-9c28-4506-9700-639493ba9ad3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:30.305521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1aeb80cf-9c28-4506-9700-639493ba9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:30.369232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1396/2792] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:30.392563 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:30.466292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea3aab-5854-4018-be6e-d54d5e0feab8 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:30.472215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:30.473332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:30.473608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:30.473876 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:30.482374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:30.483980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:30.493971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1397/2793] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:32.759496 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd297-68a8-4f73-9a9d-f78b92679cc2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:32.759975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd297-68a8-4f73-9a9d-f78b92679cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:32.760380 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd297-68a8-4f73-9a9d-f78b92679cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:32.793605 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b6abd297-68a8-4f73-9a9d-f78b92679cc2 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:32.793860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b6abd297-68a8-4f73-9a9d-f78b92679cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:32.867534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1397/2794] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:33.024692 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:33.026121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:33.046742 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:33.094313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861a882-3739-4c8a-97c0-8d958508b6ee service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:33.099978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:33.100575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:33.100850 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:33.101119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:33.109539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:33.111399 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:33.119323 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1398/2795] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:10:33.936437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ff9e-9c15-4dab-94f3-c07cbcf8acb8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:33.936903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ff9e-9c15-4dab-94f3-c07cbcf8acb8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:33.936999 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ff9e-9c15-4dab-94f3-c07cbcf8acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:33.955887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c00ff9e-9c15-4dab-94f3-c07cbcf8acb8 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:33.957059 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c00ff9e-9c15-4dab-94f3-c07cbcf8acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:33.964648 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1398/2796] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:10:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:33.977717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:33.988311 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce8d-8056-4016-a402-c868c6a890bf service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:33.994119 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:33.994741 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:33.995021 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:33.995297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:34.004169 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:34.010156 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:34.014991 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1399/2797] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:10:34.100586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2686-6dab-4c1e-8188-377efc09ca19 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:34.100880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2686-6dab-4c1e-8188-377efc09ca19 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:34.101168 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2686-6dab-4c1e-8188-377efc09ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:34.120835 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-130c2686-6dab-4c1e-8188-377efc09ca19 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:34.122040 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-130c2686-6dab-4c1e-8188-377efc09ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:34.130215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1399/2798] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:34.156194 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:34.157618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:34.186393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c45e7a-6943-475c-a583-7c81e4f3210f service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:34.192489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:34.193600 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:34.194682 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:34.195134 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:34.206783 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:34.208829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:34.220174 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1400/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:34.729747 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa102-7a32-4b6b-8625-484e749177e5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:34.730037 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa102-7a32-4b6b-8625-484e749177e5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:34.730331 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fa102-7a32-4b6b-8625-484e749177e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:34.751691 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2c4fa102-7a32-4b6b-8625-484e749177e5 None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:34.752922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2c4fa102-7a32-4b6b-8625-484e749177e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:34.760773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1400/2800] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Aug 12 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:34.772652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:34.783841 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d5790-23fc-4d80-af74-8e536c3e0b06 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:34.790731 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:34.791476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:34.791754 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:34.792027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:34.799962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:34.801831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:34.810782 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1401/2801] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 12:10:35.482595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:35.483065 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:35.483162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:35.501852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] MFA Rules not processed for user `21f021f13320436c95800de92d844fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:35.503068 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:35.510609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1401/2802] 10.222.0.18 () {58 vars in 967 bytes} [Fri Aug 12 12:10:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:35.523786 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:35.538057 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0207-ca7d-44fb-84d8-a75094c5a93c service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:35.653907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fae4b6d2e7f5478495814d5f392b2b27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:35.653907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:35.653907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:35.653907 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:35.656035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:35.656035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:35.656035 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1402/2803] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Aug 12 12:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 12:10:35.656603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:35.656603 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:35.667071 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbae8f-498c-4412-b092-8c8e4056dead None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:35.671651 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:35.672277 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:35.672554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:35.672820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] PATH_INFO: `/v3/users/1322bb5640a34b6eb86f181dc64f82f3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:35.673954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1322bb5640a34b6eb86f181dc64f82f3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:35.676203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:36.036543 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1322bb5640a34b6eb86f181dc64f82f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.166426 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1322bb5640a34b6eb86f181dc64f82f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.176399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:36.183469 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1322bb5640a34b6eb86f181dc64f82f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.190275 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1322bb5640a34b6eb86f181dc64f82f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.191030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1322bb5640a34b6eb86f181dc64f82f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.198451 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1402/2804] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:35 2022] DELETE /identity/v3/users/1322bb5640a34b6eb86f181dc64f82f3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:36.509709 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:36.542219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67379-2705-4d6b-a778-b44271d637ae service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:36.627468 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:36.628185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:36.628543 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:36.628918 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] PATH_INFO: `/v3/projects/e85f665484774cc2a8d940a96f2ed1b8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:36.630330 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85f665484774cc2a8d940a96f2ed1b8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:36.632484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:36.740413 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:36.743313 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85f665484774cc2a8d940a96f2ed1b8', 'request_id': 'req-971253f7-8b03-4f4f-8d7b-2f519b1b3508'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.749802 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85f665484774cc2a8d940a96f2ed1b8', 'request_id': 'req-971253f7-8b03-4f4f-8d7b-2f519b1b3508'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.837414 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85f665484774cc2a8d940a96f2ed1b8', 'request_id': 'req-971253f7-8b03-4f4f-8d7b-2f519b1b3508'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.848209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] The token cache is being invalidate because project e85f665484774cc2a8d940a96f2ed1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:36.849424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.849424 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-971253f7-8b03-4f4f-8d7b-2f519b1b3508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:36.850611 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1403/2805] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:36 2022] DELETE /identity/v3/projects/e85f665484774cc2a8d940a96f2ed1b8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:36.854732 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:36.857577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:36.872404 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282452cc-3269-46e3-bdff-9b704db4bf7b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:36.929041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:36.929700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:36.929980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:36.930250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] PATH_INFO: `/v3/users/9e085735ae4c41c7941082051101febc` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:36.935570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e085735ae4c41c7941082051101febc)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:36.935570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:37.213359 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e085735ae4c41c7941082051101febc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.320824 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e085735ae4c41c7941082051101febc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.338165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e085735ae4c41c7941082051101febc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.346479 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e085735ae4c41c7941082051101febc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.347494 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e085735ae4c41c7941082051101febc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.351148 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:37.351436 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:37.351711 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:37.361043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1403/2806] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:36 2022] DELETE /identity/v3/users/9e085735ae4c41c7941082051101febc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:37.390869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:37.392092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:37.478873 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1404/2807] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:37.505456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:37.505456 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:37.574360 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:37.589961 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9c37-7f88-41c7-b08b-13fd2be72c8a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:37.595414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:37.596041 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:37.596312 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:37.596577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:37.605190 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:37.606780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575abc4-100f-4289-91ea-4d4d30dda9b5 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:37.616320 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1404/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:37.699004 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:37.700697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:37.722421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629c2ff-02f8-4b93-949c-e391ad58c6cb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:37.722421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:37.722421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:37.722421 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:37.723196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] PATH_INFO: `/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:37.723196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d40d9397ae4d25ae4cd043f9ec0a77)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:37.734744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:37.859066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d40d9397ae4d25ae4cd043f9ec0a77', 'request_id': 'req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.866345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d40d9397ae4d25ae4cd043f9ec0a77', 'request_id': 'req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.954437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d40d9397ae4d25ae4cd043f9ec0a77', 'request_id': 'req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.965540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] The token cache is being invalidate because project d8d40d9397ae4d25ae4cd043f9ec0a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:37.965836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.966467 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-cc99bfaf-53b4-4f8d-8ea7-032b253d373c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:37.967985 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1405/2809] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:37 2022] DELETE /identity/v3/projects/d8d40d9397ae4d25ae4cd043f9ec0a77 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:37.972926 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:37.973399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:37.973510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:37.993490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:37.994725 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:38.062408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1405/2810] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:38.071507 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.071789 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.072082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.091630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:38.092962 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:38.100811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1406/2811] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:38.105043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.114718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf667-501f-4fc1-9a44-d9ac3b69e2e2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.120158 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.120763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.121054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.121325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.121980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:38.122281 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.123914 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.135995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1406/2812] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:10:38.140331 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.151792 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f417f-05e2-4edb-a516-920c86df912e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.157479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.162450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.162450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.162450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.162450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.162450 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.268018 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1407/2813] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:38 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:38.272054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.281981 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27421-0e24-4f7d-bbb7-c15ba1820ffe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.342829 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.343440 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.343720 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.343992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.344626 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.346548 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.429652 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1407/2814] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:38 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 12:10:38.433595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.444893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb7141-5fcd-4a20-87c8-d031d9d095f2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.449624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.450227 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.451161 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.451499 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.452066 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.453645 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.464872 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1408/2815] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:38.468821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.479514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9622a9-7f52-489a-bf2d-ff28220ad63c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.484192 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.484782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.485063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.485337 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.485977 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.487633 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad25fb-b7a9-46ca-a77f-343f23024736 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.500664 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1408/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:38.504793 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.516101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b59f4-0f6d-4060-ba53-13deecb94c7e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.520717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.521939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.522209 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.522478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] PATH_INFO: `/v3/projects/6310ab2539f54519ac1cf507315907f6/users/3ee0c7e9942f4c6793aeb17738eef7eb/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.536800 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6310ab2539f54519ac1cf507315907f6, user_id=3ee0c7e9942f4c6793aeb17738eef7eb, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.539437 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.541559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:38.632557 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1409/2817] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:38 2022] PUT /identity/v3/projects/6310ab2539f54519ac1cf507315907f6/users/3ee0c7e9942f4c6793aeb17738eef7eb/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:38.642546 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.642846 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.643123 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.670545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] MFA Rules not processed for user `3ee0c7e9942f4c6793aeb17738eef7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:38.671785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:38.713570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:38.735228 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1409/2818] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:38.748224 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.750041 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:38.812779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb430-9d11-4590-bec8-6dc7e0f53654 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.817533 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.818776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.819062 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.819336 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.834473 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.835998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.845545 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1410/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:38.850655 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.852103 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:38.865199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:38.920761 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1b6da-fc1a-4a18-a1ac-8c5b4ac2474a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.925939 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.926599 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.926877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.927148 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] PATH_INFO: `/v3/users/e2c0bfd297da4597a8a9cef47d41e742` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.927287 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a7d3-563a-4e32-aef0-fb4e8ab070c8 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:38.928308 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c0bfd297da4597a8a9cef47d41e742)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.930235 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:38.931999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:38.933340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:38.933340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:38.933340 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] PATH_INFO: `/v3/users/3ee0c7e9942f4c6793aeb17738eef7eb` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:38.934285 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee0c7e9942f4c6793aeb17738eef7eb)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:38.936219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:39.159279 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c0bfd297da4597a8a9cef47d41e742'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.225008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c0bfd297da4597a8a9cef47d41e742'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.238281 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee0c7e9942f4c6793aeb17738eef7eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.242250 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c0bfd297da4597a8a9cef47d41e742'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.250019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c0bfd297da4597a8a9cef47d41e742'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.250805 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63063fb2-51db-484b-ae6a-c9053323c827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c0bfd297da4597a8a9cef47d41e742'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.257254 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1410/2820] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:38 2022] DELETE /identity/v3/users/e2c0bfd297da4597a8a9cef47d41e742 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:39.261500 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07abd-a189-46ac-92e3-323f681d8c44 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:39.261815 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07abd-a189-46ac-92e3-323f681d8c44 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:39.262064 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07abd-a189-46ac-92e3-323f681d8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:39.281474 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a6c07abd-a189-46ac-92e3-323f681d8c44 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:39.282733 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a6c07abd-a189-46ac-92e3-323f681d8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:39.320137 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee0c7e9942f4c6793aeb17738eef7eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.335721 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee0c7e9942f4c6793aeb17738eef7eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.344075 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee0c7e9942f4c6793aeb17738eef7eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.344747 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee0c7e9942f4c6793aeb17738eef7eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.347184 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1411/2821] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:39.353796 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1411/2822] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:38 2022] DELETE /identity/v3/users/3ee0c7e9942f4c6793aeb17738eef7eb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:39.355328 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:39.355877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:39.356164 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:39.356478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:39.357908 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:39.363233 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:39.377273 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:39.378068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:39.378488 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:39.424079 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3107-715d-4cd6-bdfc-68768f487267 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:39.428048 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:39.428660 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:39.428939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:39.429228 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:39.431019 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:39.441413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1412/2823] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:39.452110 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:39.462802 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa8c3-f0a4-42ba-8163-1504c4a51ef1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:39.466559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:39.467179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:39.467461 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:39.467726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:39.478100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:39.479785 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:39.489236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1413/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:10:39.507402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:39.508877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:39.518964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1412/2825] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:10:39.784526 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:39.786008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:39.799428 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b1e2-9711-41c7-a475-e49eac5b393c service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:39.806647 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:39.807400 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:39.807762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:39.808102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] PATH_INFO: `/v3/projects/33967608284a412bb80590a25b69fb66` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:39.809332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33967608284a412bb80590a25b69fb66)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:39.811350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:39.941521 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33967608284a412bb80590a25b69fb66', 'request_id': 'req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:39.947931 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33967608284a412bb80590a25b69fb66', 'request_id': 'req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.001128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.001128 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:40.018631 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f995a1-afa3-4955-bde8-e6fc49ad7720 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.020339 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33967608284a412bb80590a25b69fb66', 'request_id': 'req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.037782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] The token cache is being invalidate because project 33967608284a412bb80590a25b69fb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:40.038073 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.038763 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-983edaee-f1c8-4df2-a8ce-3da5cc0bea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.057695 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1414/2826] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:39 2022] DELETE /identity/v3/projects/33967608284a412bb80590a25b69fb66 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:40.092607 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.093317 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.093596 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.093866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] PATH_INFO: `/v3/projects/6310ab2539f54519ac1cf507315907f6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.095092 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6310ab2539f54519ac1cf507315907f6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.097130 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.248640 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6310ab2539f54519ac1cf507315907f6', 'request_id': 'req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.256083 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6310ab2539f54519ac1cf507315907f6', 'request_id': 'req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.334391 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6310ab2539f54519ac1cf507315907f6', 'request_id': 'req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.339622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:40.346903 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] The token cache is being invalidate because project 6310ab2539f54519ac1cf507315907f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:40.347196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.347836 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e7d4546f-e3cb-40fc-8ea1-5d6de6fee3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:40.352828 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1413/2827] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:39 2022] DELETE /identity/v3/projects/6310ab2539f54519ac1cf507315907f6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:40.354774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020d41-df83-4693-a249-6a53609033f0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.355255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020d41-df83-4693-a249-6a53609033f0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.355378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020d41-df83-4693-a249-6a53609033f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.375286 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-71020d41-df83-4693-a249-6a53609033f0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:40.376490 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-71020d41-df83-4693-a249-6a53609033f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:40.439234 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1415/2828] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:40.501651 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.501935 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.502213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.522476 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:40.527575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:40.532153 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1414/2829] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:40.536445 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020d41-df83-4693-a249-6a53609033f0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.546828 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020d41-df83-4693-a249-6a53609033f0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.551787 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.552394 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.552734 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.552943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.553588 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:40.553897 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.555554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.564632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:40.570556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1416/2830] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:10:40.572454 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.582374 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90903673-e1f0-4b54-89a9-431c149a9c48 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.587856 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.588466 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.590046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.590046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.590046 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.591878 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.707356 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1415/2831] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:40 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:40.711911 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.721821 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d168a7-3b61-46a5-8ffd-eb40143ff33e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.777769 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.778378 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.779420 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.779740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.780413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.782724 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.868593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1417/2832] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:40 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:40.872470 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.883037 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d4715-2b38-40fa-ba66-1f8d2daa119c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.887641 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.888232 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.888510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.888780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.889463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.891135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.900779 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1416/2833] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:40.904622 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.915053 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f1bf7-da6e-4bac-8ff1-57355344df04 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.919544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.923431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.923431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.923431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.923431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.923431 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29d4e-e011-4cad-a832-90efa931cd29 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:40.934147 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1418/2834] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:40.938463 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:40.948255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95550f64-bd46-47ef-97ff-02db4b46a8a6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:40.952757 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:40.953387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:40.953663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:40.953931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] PATH_INFO: `/v3/projects/818f24ce051c434b94fdd2b4267e3b99/users/c6f73e14d75b4af2aa9025933d3aa63e/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:40.968811 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f24ce051c434b94fdd2b4267e3b99, user_id=c6f73e14d75b4af2aa9025933d3aa63e, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:40.971478 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.066003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1417/2835] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:40 2022] PUT /identity/v3/projects/818f24ce051c434b94fdd2b4267e3b99/users/c6f73e14d75b4af2aa9025933d3aa63e/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:41.076025 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.076307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.076580 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.104800 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] MFA Rules not processed for user `c6f73e14d75b4af2aa9025933d3aa63e`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:41.105987 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:41.169268 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1419/2836] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:41.173885 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.235064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bb26-513b-4c15-bcc3-9b956ef3049c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.240233 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.240831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.241112 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.241394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.242058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.243941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.341394 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1418/2837] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:41.345352 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.357008 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6060ac-7c97-4ee3-b80f-b3827fb93c58 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.419301 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.420078 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.420506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.420783 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.421418 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.423408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.517762 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:41.524818 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1420/2838] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:41.528893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.539434 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11e49f-306c-49f6-93a5-5b7b77891a3c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.544093 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.544695 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.544971 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.545239 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.545877 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.547491 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.558595 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1419/2839] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:41.562683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.573102 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cfa5-3895-4c06-9111-1ba5b32fd209 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.577674 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.578264 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.578578 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.578854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.579514 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.581124 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72759b2-dc3b-4c8c-8c4b-22668850dd63 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.592350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1421/2840] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:41.596345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.606297 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc1c0-d6b8-4dda-9c04-de8f2b9b58d3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.610941 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.611575 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.611852 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.612121 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] PATH_INFO: `/v3/projects/a4336e97ec32440dacd8b8b09f97ad0b/users/17fb9cbc447c4615badeaafa5d15b3aa/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.629776 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4336e97ec32440dacd8b8b09f97ad0b, user_id=17fb9cbc447c4615badeaafa5d15b3aa, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.629884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa4ab6-85cd-4fa9-933f-746d4625a6c9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.694740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.695091 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.695430 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.721791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1420/2841] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:41 2022] PUT /identity/v3/projects/a4336e97ec32440dacd8b8b09f97ad0b/users/17fb9cbc447c4615badeaafa5d15b3aa/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:41.724975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:41.724975 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:41.725175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.725175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.725175 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.754343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] MFA Rules not processed for user `17fb9cbc447c4615badeaafa5d15b3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:41.756005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:41.788449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1422/2842] 10.222.0.30 () {58 vars in 1016 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:41.793894 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:41.811003 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.812719 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:41.834292 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1421/2843] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:41.835383 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.845697 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9b9f3-cebc-4a46-951e-2715e842b8e3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.851429 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.852024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.852304 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.852576 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.853186 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.855234 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.888885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a8dfb-1ce4-44b6-8035-101627244869 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:41.895808 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d46631580f04d5b8eb42424d520f83c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:41.896943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:41.897224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:41.897499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:41.905689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:41.909222 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:41.917185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1423/2844] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:41.972790 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1422/2845] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:41.977524 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:41.987683 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac871ce-a89c-467d-ba22-d64d2aa19a27 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.046595 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.047298 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.052967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.052967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.052967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.052967 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.167554 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1424/2846] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:41 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:42.170821 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:42.182196 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c15015-7909-4e9a-bcb5-d4fa5ad51256 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.186938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.187462 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.187739 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.188013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.188774 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.190393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.200484 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1423/2847] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:42.204841 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:42.210305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:42.215591 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158b1cf-e096-4264-ac0c-983c667ce6cf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.220205 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.220853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.221133 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.221408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] PATH_INFO: `/v3/projects/3221514ccc3542b78217572c11a49fa1/users/0640adfd0435493e868b78c3171c595f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.236165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3221514ccc3542b78217572c11a49fa1, user_id=0640adfd0435493e868b78c3171c595f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.238880 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.344224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1425/2848] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:42 2022] PUT /identity/v3/projects/3221514ccc3542b78217572c11a49fa1/users/0640adfd0435493e868b78c3171c595f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:42.345263 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:42.355510 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312512a-a3dc-4476-b12e-c165b51616e7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.421831 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.422443 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.422746 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.423045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.423855 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.425333 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c116e55-bb58-4bed-b548-34671502b50a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.435827 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1424/2849] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:10:42.439943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:42.450715 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953e424-e533-41a3-8d59-b8d67ad29dcf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.455415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.456067 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.459100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.459100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] PATH_INFO: `/v3/projects/3221514ccc3542b78217572c11a49fa1/users/0640adfd0435493e868b78c3171c595f/roles/5540f9b1011544929fd18ae216a070b0` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.459355 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3221514ccc3542b78217572c11a49fa1, user_id=0640adfd0435493e868b78c3171c595f, role_id=5540f9b1011544929fd18ae216a070b0)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.461712 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.472188 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1426/2850] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:42 2022] PUT /identity/v3/projects/3221514ccc3542b78217572c11a49fa1/users/0640adfd0435493e868b78c3171c595f/roles/5540f9b1011544929fd18ae216a070b0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:42.482425 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.482740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.485459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.511652 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] MFA Rules not processed for user `0640adfd0435493e868b78c3171c595f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:42.512898 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:42.581253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1425/2851] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:42.593119 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:42.594907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:42.652594 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0aff-5e5a-4a08-b05e-2be727223503 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:42.656176 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:42.656767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:42.657042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:42.657311 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:42.726749 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:42.728270 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:42.738159 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1427/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:44.792068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:44.793571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:44.809753 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca66063-8a03-4814-a331-2daf4d92b230 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:44.814344 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:44.815005 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:44.815675 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:44.815960 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:44.835570 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:44.877624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:44.879084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:44.888410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1426/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:46.422054 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:46.431410 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6540ee-81bb-4b63-a7de-27071d76d83b service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:46.435016 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:46.435617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:46.435891 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:46.436161 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:46.446991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:46.449288 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efbd08-13af-4dd2-9d4e-f88aece8a4d0 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:46.464122 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1428/2854] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:48.778700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:48.780170 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:48.845258 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b99b55-2ed3-42f5-b17f-844c53c1bf64 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:48.850325 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:48.850978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:48.851253 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:48.851521 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] PATH_INFO: `/v3/users/f256492ca9c34838b092a244aa640579` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:48.852635 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f256492ca9c34838b092a244aa640579)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:48.854535 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:49.140925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f256492ca9c34838b092a244aa640579'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:49.205738 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f256492ca9c34838b092a244aa640579'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:49.219289 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f256492ca9c34838b092a244aa640579'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:49.226197 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f256492ca9c34838b092a244aa640579'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:49.226948 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f256492ca9c34838b092a244aa640579'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:49.232797 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1427/2855] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:48 2022] DELETE /identity/v3/users/f256492ca9c34838b092a244aa640579 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:49.237166 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:49.237649 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:49.237780 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:49.257617 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:49.258853 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:49.318659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1429/2856] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:10:49.328998 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:49.330569 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:49.377101 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:49.413859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dd8a6-43e8-40f8-aab7-309fa3509ff7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:49.417770 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:49.418382 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:49.418707 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:49.419024 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:49.429634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:49.431089 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ece04-c34e-408e-9fc2-0c4fe48d6cc6 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:49.440447 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1428/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:49.852136 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:49.853740 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:49.865887 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833005b-27bc-429b-91ec-ad196626fdcd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:49.870700 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:49.871332 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:49.871608 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:49.871878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] PATH_INFO: `/v3/projects/0e3381082d0846a693b226cec98e43f4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:49.873012 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3381082d0846a693b226cec98e43f4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:49.875236 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:49.876657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:49.997266 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3381082d0846a693b226cec98e43f4', 'request_id': 'req-164bcd6f-5077-464b-bf3c-91000f0d9561'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:50.004019 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3381082d0846a693b226cec98e43f4', 'request_id': 'req-164bcd6f-5077-464b-bf3c-91000f0d9561'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:50.085300 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3381082d0846a693b226cec98e43f4', 'request_id': 'req-164bcd6f-5077-464b-bf3c-91000f0d9561'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:50.098177 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] The token cache is being invalidate because project 0e3381082d0846a693b226cec98e43f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:50.098499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:50.099261 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-164bcd6f-5077-464b-bf3c-91000f0d9561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:50.101182 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1430/2858] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:49 2022] DELETE /identity/v3/projects/0e3381082d0846a693b226cec98e43f4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:50.106614 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.107084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.107185 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.125976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:50.127219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:50.187114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1429/2859] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:50.194539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.194844 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.196393 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.219310 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:50.220510 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:50.228973 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1431/2860] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:50.233211 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.242976 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c191c4-4d62-4efc-a631-124c8f538b27 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.247568 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.248163 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.248441 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.248714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.249422 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:50.249714 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.251364 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.262743 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1430/2861] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:10:50.266786 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.276437 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5a96c-aa0f-4740-abd9-6db2260ca14c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.281043 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.281658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.281935 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.282202 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.282857 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.284723 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.377464 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1432/2862] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:50 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:50.381604 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.394401 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db505ff-f4aa-4662-b513-e9656fa0ebd0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.460524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.460524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.460524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.460524 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.461116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.461116 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.548370 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1431/2863] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:50 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:50.552953 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.563901 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ae55-d21f-4d12-9c31-b82129fc8628 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.568661 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.569260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.569536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.569819 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.570465 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.572089 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.581907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1433/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:50.585904 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.596033 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270bfa-92ae-4bbc-9950-3132cc986688 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.600636 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.601764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.602060 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.602345 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.603082 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.604663 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1b3a2-8296-45b9-9bbf-0bfd5f09b21c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.615553 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1432/2865] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:50.620244 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.630484 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803999f3-fc22-43f6-a89a-d798442981fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.635696 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.636334 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.636609 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.636878 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] PATH_INFO: `/v3/projects/af628dc533d44c2fb8443533e88de430/users/cafc78d5b88b404ea8a43333fee50be5/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.651816 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af628dc533d44c2fb8443533e88de430, user_id=cafc78d5b88b404ea8a43333fee50be5, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.654413 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.730944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1434/2866] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:50 2022] PUT /identity/v3/projects/af628dc533d44c2fb8443533e88de430/users/cafc78d5b88b404ea8a43333fee50be5/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:50.741052 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.741332 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.741603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.769727 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] MFA Rules not processed for user `cafc78d5b88b404ea8a43333fee50be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:50.770979 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:50.782819 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:50.832303 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1433/2867] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:50.843623 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:50.845309 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:50.900646 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801d079-ac3e-48fb-a9ec-785046b83e5d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:50.904752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fb6edf322d64dad81ac0bca7a1c32c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:50.905350 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:50.905631 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:50.905902 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:50.914577 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:50.916142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440f6c5-68fc-44d6-bbc5-e043fad82277 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:50.926774 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1435/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:10:51.103339 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:51.104740 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:51.173063 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca836a3d-5e34-4fa3-b385-ca4093b756a8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:51.178386 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:51.179056 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:51.179358 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:51.179616 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] PATH_INFO: `/v3/users/c6f73e14d75b4af2aa9025933d3aa63e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:51.180751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f73e14d75b4af2aa9025933d3aa63e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:51.182724 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:51.398816 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f73e14d75b4af2aa9025933d3aa63e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:51.496722 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f73e14d75b4af2aa9025933d3aa63e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:51.511104 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f73e14d75b4af2aa9025933d3aa63e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:51.518096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f73e14d75b4af2aa9025933d3aa63e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:51.518883 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f73e14d75b4af2aa9025933d3aa63e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:51.525974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1434/2869] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:51 2022] DELETE /identity/v3/users/c6f73e14d75b4af2aa9025933d3aa63e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:51.530203 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:51.530773 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:51.530925 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:51.569271 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:51.570539 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:51.604215 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:51.639790 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1436/2870] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:51.649587 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:51.652010 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:51.694449 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:51.711869 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7364953-b986-48c0-86e9-da019b8e1575 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:51.715622 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:51.716230 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:51.716526 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:51.716764 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:51.727679 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:51.729446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:51.739884 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1435/2871] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:52.246230 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:52.248718 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:52.261408 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f062-21d2-49d9-8775-8a3162ff7ac0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:52.266173 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:52.266958 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:52.267100 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:52.267373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] PATH_INFO: `/v3/projects/818f24ce051c434b94fdd2b4267e3b99` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:52.268506 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818f24ce051c434b94fdd2b4267e3b99)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:52.270405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:52.375944 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818f24ce051c434b94fdd2b4267e3b99', 'request_id': 'req-681cc14d-f169-4a5f-8092-d110e9aab7a7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.382767 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818f24ce051c434b94fdd2b4267e3b99', 'request_id': 'req-681cc14d-f169-4a5f-8092-d110e9aab7a7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.467900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818f24ce051c434b94fdd2b4267e3b99', 'request_id': 'req-681cc14d-f169-4a5f-8092-d110e9aab7a7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.483862 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] The token cache is being invalidate because project 818f24ce051c434b94fdd2b4267e3b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:52.484383 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.485692 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.490606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1437/2872] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:52 2022] DELETE /identity/v3/projects/818f24ce051c434b94fdd2b4267e3b99 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:52.494965 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:52.504745 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548dea3-147c-4aa3-8f80-1d623b342f0e service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:52.558252 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:52.559753 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:52.565438 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:52.565749 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:52.566012 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:52.566435 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] PATH_INFO: `/v3/users/17fb9cbc447c4615badeaafa5d15b3aa` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:52.569590 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fb9cbc447c4615badeaafa5d15b3aa)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:52.572202 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:52.657063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc14d-f169-4a5f-8092-d110e9aab7a7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:52.662950 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '845278e5b9a74508acc333f09a2df68a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:52.664256 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:52.664536 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:52.664809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:52.666593 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:52.678745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:52.680858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:52.690638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1438/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 12:10:52.716700 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fb9cbc447c4615badeaafa5d15b3aa'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.787571 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fb9cbc447c4615badeaafa5d15b3aa'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.803603 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fb9cbc447c4615badeaafa5d15b3aa'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.811820 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fb9cbc447c4615badeaafa5d15b3aa'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.812618 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fb9cbc447c4615badeaafa5d15b3aa'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:52.818826 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1436/2874] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:52 2022] DELETE /identity/v3/users/17fb9cbc447c4615badeaafa5d15b3aa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:53.279745 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:53.281282 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:53.296532 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61567cd8-6295-4a3e-bf6d-f2595ae4c350 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:53.317439 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:53.357534 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:53.358172 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:53.358454 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:53.358759 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] PATH_INFO: `/v3/projects/a4336e97ec32440dacd8b8b09f97ad0b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:53.359885 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4336e97ec32440dacd8b8b09f97ad0b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:53.361903 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:53.488945 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4336e97ec32440dacd8b8b09f97ad0b', 'request_id': 'req-44570838-c10b-4d5b-8929-e2710fe4507c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.495813 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4336e97ec32440dacd8b8b09f97ad0b', 'request_id': 'req-44570838-c10b-4d5b-8929-e2710fe4507c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.541992 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4336e97ec32440dacd8b8b09f97ad0b', 'request_id': 'req-44570838-c10b-4d5b-8929-e2710fe4507c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.553566 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] The token cache is being invalidate because project a4336e97ec32440dacd8b8b09f97ad0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:53.553870 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.555586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.557179 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1439/2875] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:53 2022] DELETE /identity/v3/projects/a4336e97ec32440dacd8b8b09f97ad0b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:53.561400 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:53.562839 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:53.577409 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825fe2c-ce0d-4056-9c54-21686931fcc2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:53.631349 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:53.637293 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:53.637925 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:53.638204 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:53.638479 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] PATH_INFO: `/v3/users/0640adfd0435493e868b78c3171c595f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:53.639686 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0640adfd0435493e868b78c3171c595f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:53.641594 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:53.825461 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0640adfd0435493e868b78c3171c595f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.884756 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0640adfd0435493e868b78c3171c595f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.898058 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0640adfd0435493e868b78c3171c595f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.904866 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0640adfd0435493e868b78c3171c595f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.905539 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2cd2bf2d-a7d9-432f-a9f7-5c0c98c171f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0640adfd0435493e868b78c3171c595f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:53.917859 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1437/2876] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:53 2022] DELETE /identity/v3/users/0640adfd0435493e868b78c3171c595f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:54.389109 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:54.390702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:54.403520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570838-c10b-4d5b-8929-e2710fe4507c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:54.475149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:54.475820 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:54.477224 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:54.477508 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] PATH_INFO: `/v3/projects/3221514ccc3542b78217572c11a49fa1` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:54.478714 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3221514ccc3542b78217572c11a49fa1)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:54.480659 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:54.595153 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3221514ccc3542b78217572c11a49fa1', 'request_id': 'req-01771c5d-10d4-4d0b-a4d4-215edd71ead1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:54.602657 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3221514ccc3542b78217572c11a49fa1', 'request_id': 'req-01771c5d-10d4-4d0b-a4d4-215edd71ead1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:54.604348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:54.705343 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3221514ccc3542b78217572c11a49fa1', 'request_id': 'req-01771c5d-10d4-4d0b-a4d4-215edd71ead1'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:54.717125 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] The token cache is being invalidate because project 3221514ccc3542b78217572c11a49fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:54.717409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:54.718023 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01771c5d-10d4-4d0b-a4d4-215edd71ead1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:54.719530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1440/2877] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:54 2022] DELETE /identity/v3/projects/3221514ccc3542b78217572c11a49fa1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:54.724540 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:54.725084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:54.725084 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:54.745068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:54.746290 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:54.810254 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1438/2878] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:54.819417 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:54.820326 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:54.820606 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:54.840638 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:54.841854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:54.849860 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1441/2879] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:54.854939 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:54.864608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044ec4b-8c11-4d35-9be2-e2d7acaa1cba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:54.871550 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:54.872099 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:54.872377 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:54.872649 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:54.873343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:10:54.873664 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:54.875301 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:54.887182 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1439/2880] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 12:10:54.891564 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:54.900635 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8761a6-684e-444a-8c5f-6f27cfbb3745 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:54.905542 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:54.906142 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:54.906414 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:54.906775 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:54.907399 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:54.909265 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.003910 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1442/2881] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:10:54 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:55.007064 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.018090 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5fde-562e-4709-930b-6efe5acc6239 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.076814 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.077417 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.077691 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.077964 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.078606 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.080638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.093410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:55.193780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1440/2882] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:10:55 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:10:55.199970 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.212493 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab69b09-916e-4d2d-b9ab-12ab626ffa1d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.217111 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.217702 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.217980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.218249 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.218954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.220544 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.232943 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1443/2883] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:55.237193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.248027 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9cb2-e693-4a99-aac9-b654314d742f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.253264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.256943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.256943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.256943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.256943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.256943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c844c-023b-4970-80e2-3194525f035c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.268376 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1441/2884] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:10:55.272586 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.283032 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f48fe5-ccb4-4b6e-b1eb-8e30e535531e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.287782 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.288453 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.288726 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.288995 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] PATH_INFO: `/v3/projects/81da1a0991d04016ac06ab79d057265f/users/460616aa2f8b49389f785bb517591be4/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.304936 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81da1a0991d04016ac06ab79d057265f, user_id=460616aa2f8b49389f785bb517591be4, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.307584 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.391463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1444/2885] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:10:55 2022] PUT /identity/v3/projects/81da1a0991d04016ac06ab79d057265f/users/460616aa2f8b49389f785bb517591be4/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:10:55.404397 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.404717 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.404999 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.437954 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] MFA Rules not processed for user `460616aa2f8b49389f785bb517591be4`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:55.439215 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:55.517566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1442/2886] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:55.532386 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.534090 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:55.631634 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89526-5d04-4153-9f2c-356bc5f11541 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.636070 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.636568 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.636852 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.637130 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.646637 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.648377 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07886ed9-a065-4880-9e5b-fac3e8a72e38 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.662057 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1445/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:55.693404 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:55.769152 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a5c8-3681-4ef9-94b4-effa424b3200 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:55.774264 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:55.774938 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:55.779950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:55.779950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] PATH_INFO: `/v3/users/460616aa2f8b49389f785bb517591be4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:55.779950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=460616aa2f8b49389f785bb517591be4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:55.779950 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:55.986086 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460616aa2f8b49389f785bb517591be4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.051013 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460616aa2f8b49389f785bb517591be4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.064055 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460616aa2f8b49389f785bb517591be4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.066188 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:56.071629 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460616aa2f8b49389f785bb517591be4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.072352 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460616aa2f8b49389f785bb517591be4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.078091 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1443/2888] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:10:55 2022] DELETE /identity/v3/users/460616aa2f8b49389f785bb517591be4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:10:56.082711 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:56.088305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:56.088305 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:56.102922 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:10:56.104114 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:56.167831 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1446/2889] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:10:56.178586 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:56.180838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:56.246199 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aba26-a9f5-43ad-9fde-9f054ef090ac admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:56.249989 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:56.250630 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:56.251155 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:56.251459 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:56.261451 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:56.262974 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:56.273620 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1444/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:10:56.754877 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:10:56.756964 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:10:56.764217 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:10:56.771238 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf683f36-cba1-4483-b2cb-6f9640934369 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:10:56.777216 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:10:56.777966 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:10:56.778313 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:10:56.778616 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] PATH_INFO: `/v3/projects/81da1a0991d04016ac06ab79d057265f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:10:56.780530 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81da1a0991d04016ac06ab79d057265f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:10:56.782570 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:10:56.881191 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81da1a0991d04016ac06ab79d057265f', 'request_id': 'req-619e0305-693a-4558-aa6c-4c48d0173df7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.887915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81da1a0991d04016ac06ab79d057265f', 'request_id': 'req-619e0305-693a-4558-aa6c-4c48d0173df7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.953556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81da1a0991d04016ac06ab79d057265f', 'request_id': 'req-619e0305-693a-4558-aa6c-4c48d0173df7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.965042 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] The token cache is being invalidate because project 81da1a0991d04016ac06ab79d057265f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:10:56.965403 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.966063 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:10:56.967629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1447/2891] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:10:56 2022] DELETE /identity/v3/projects/81da1a0991d04016ac06ab79d057265f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:06.719159 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=30 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:07.076983 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:14.476583 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:14.478002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:14.492862 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36363a-96e1-458d-b428-638d0ea93842 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:14.548780 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:14.549338 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:14.549619 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:14.549893 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] PATH_INFO: `/v3/users/9d7a0aeef047474894c4e16edfe1f5f4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:14.551361 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7a0aeef047474894c4e16edfe1f5f4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:14.553270 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:14.785915 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7a0aeef047474894c4e16edfe1f5f4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:14.869978 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7a0aeef047474894c4e16edfe1f5f4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:14.882231 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7a0aeef047474894c4e16edfe1f5f4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:14.889002 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7a0aeef047474894c4e16edfe1f5f4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:14.889634 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4696ee9e-5879-42b5-aaa1-d9490449a870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7a0aeef047474894c4e16edfe1f5f4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:14.895496 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1445/2892] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:11:14 2022] DELETE /identity/v3/users/9d7a0aeef047474894c4e16edfe1f5f4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:15.125405 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.126905 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:15.140653 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e0305-693a-4558-aa6c-4c48d0173df7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.198029 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.198690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.198972 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.199243 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] PATH_INFO: `/v3/projects/e62c6aceb6ee4313986667deee600c9c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.200398 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62c6aceb6ee4313986667deee600c9c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.202293 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.342415 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62c6aceb6ee4313986667deee600c9c', 'request_id': 'req-524b5666-1b58-40ff-937e-0aedc4d58975'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:15.350373 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62c6aceb6ee4313986667deee600c9c', 'request_id': 'req-524b5666-1b58-40ff-937e-0aedc4d58975'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:15.398185 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62c6aceb6ee4313986667deee600c9c', 'request_id': 'req-524b5666-1b58-40ff-937e-0aedc4d58975'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:15.409642 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] The token cache is being invalidate because project e62c6aceb6ee4313986667deee600c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:11:15.409930 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:15.410602 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-524b5666-1b58-40ff-937e-0aedc4d58975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:15.412088 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1448/2893] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:11:15 2022] DELETE /identity/v3/projects/e62c6aceb6ee4313986667deee600c9c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:11:15.416928 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.417214 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.417485 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.437525 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:11:15.438744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:15.500146 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1446/2894] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:11:15.508915 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.512690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.512690 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.529325 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:11:15.530538 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:15.538262 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1449/2895] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:11:15.542395 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.552310 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0228a-de8c-4bdb-a03b-3bba8bb87358 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.556944 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.557559 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.557838 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.558114 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.559308 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 12:11:15.559615 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.561193 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.572489 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1447/2896] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Aug 12 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 12:11:15.577348 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.586613 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7083c-4577-4f21-8fc2-4b84390be8e3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.591304 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.591900 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.592287 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.592561 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.593180 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.595105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.700689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1450/2897] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Aug 12 12:11:15 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:11:15.705003 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.714980 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624ff2-ce42-4980-9684-e3b73730f95f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.718502 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:15.771074 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.771668 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.771943 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.772216 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.772822 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.774767 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.855387 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1448/2898] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Aug 12 12:11:15 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 12:11:15.859457 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.869709 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa200cf0-e59a-413d-bf24-9fed28aab258 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.874854 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.875907 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.876364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.876744 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.877391 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.879165 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.890590 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1451/2899] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 12:11:15.894561 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.905343 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8095d32-f6d8-4419-9162-a5442eef992b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.909815 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.910402 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.916845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.916845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.916845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.916845 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0c6cc-bd1c-4557-a456-74f9579dcfc2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:15.924045 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1449/2900] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Aug 12 12:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 12:11:15.928361 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:15.939105 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5011d-7655-40c6-b3e0-83d537cca30f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:15.943689 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:15.944354 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:15.944632 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:15.944933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] PATH_INFO: `/v3/projects/8d9457356b5b4942b04c7d2224257198/users/2e0d699271034d58950d71e2454fe860/roles/6c5390de52524fd1ab2f9f4d74b70761` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:15.961809 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9457356b5b4942b04c7d2224257198, user_id=2e0d699271034d58950d71e2454fe860, role_id=6c5390de52524fd1ab2f9f4d74b70761)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:15.964449 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:16.066682 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1452/2901] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Aug 12 12:11:15 2022] PUT /identity/v3/projects/8d9457356b5b4942b04c7d2224257198/users/2e0d699271034d58950d71e2454fe860/roles/6c5390de52524fd1ab2f9f4d74b70761 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 12:11:16.076647 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:16.076934 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:16.077226 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:16.104608 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] MFA Rules not processed for user `2e0d699271034d58950d71e2454fe860`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:11:16.106442 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:16.167829 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1450/2902] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:11:16.180162 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:16.181858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:16.211951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:16.238817 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1bd2-a863-46bf-bc95-a42a377bde2c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:16.242409 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '971fc696d71f4812bf3e50bafb3871a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:16.243030 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:16.243307 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:16.243581 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:16.252209 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:16.253991 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9dba7-f721-47ad-9c37-43c8c576a751 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:16.267295 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1453/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:11:16.370994 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:16.372609 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:16.439578 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e817-9511-4b56-85a6-d93f3ecb0ffd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:16.444000 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:16.444624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:16.444901 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:16.445172 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] PATH_INFO: `/v3/users/cafc78d5b88b404ea8a43333fee50be5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:16.446282 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafc78d5b88b404ea8a43333fee50be5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:16.448213 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:16.466931 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:16.654464 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafc78d5b88b404ea8a43333fee50be5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:16.724446 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafc78d5b88b404ea8a43333fee50be5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:16.737179 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafc78d5b88b404ea8a43333fee50be5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:16.744096 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafc78d5b88b404ea8a43333fee50be5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:16.744785 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafc78d5b88b404ea8a43333fee50be5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:16.751158 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1451/2904] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:11:16 2022] DELETE /identity/v3/users/cafc78d5b88b404ea8a43333fee50be5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:16.755658 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:16.756255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:16.756255 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:16.774988 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:11:16.776181 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:16.834629 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1454/2905] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 12:11:16.844744 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:16.846164 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:16.903975 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235321a2-919d-4356-a334-f41270e1ef52 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:16.907530 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:16.908127 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:16.908474 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:16.908712 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:16.917762 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:16.919807 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:16.929638 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1452/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:11:17.639434 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:17.640908 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:17.653364 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46214983-959b-4f2c-a4ed-d70b928e4daa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:17.658306 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:17.658980 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:17.659260 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:17.659644 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] PATH_INFO: `/v3/projects/af628dc533d44c2fb8443533e88de430` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:17.660795 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af628dc533d44c2fb8443533e88de430)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:17.662764 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:17.789392 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af628dc533d44c2fb8443533e88de430', 'request_id': 'req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:17.795443 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af628dc533d44c2fb8443533e88de430', 'request_id': 'req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:17.858541 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af628dc533d44c2fb8443533e88de430', 'request_id': 'req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:17.869232 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] The token cache is being invalidate because project af628dc533d44c2fb8443533e88de430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:11:17.869520 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:17.870140 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-4149dc1e-aa7f-44fe-9d4c-3553c1d22a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:17.872227 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1455/2907] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:11:17 2022] DELETE /identity/v3/projects/af628dc533d44c2fb8443533e88de430 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:22.162566 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:22.163983 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:22.177671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a837e6a-c073-4c19-a4dd-815d18c92e9a service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:22.231772 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:22.232393 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:22.232671 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:22.232945 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] PATH_INFO: `/v3/users/2e0d699271034d58950d71e2454fe860` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:22.234068 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0d699271034d58950d71e2454fe860)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:22.236077 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:22.432959 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:22.438818 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0d699271034d58950d71e2454fe860'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:22.515624 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0d699271034d58950d71e2454fe860'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:22.527751 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0d699271034d58950d71e2454fe860'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:22.535109 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0d699271034d58950d71e2454fe860'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:22.535771 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0d699271034d58950d71e2454fe860'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:22.541532 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1453/2908] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Aug 12 12:11:22 2022] DELETE /identity/v3/users/2e0d699271034d58950d71e2454fe860 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:22.545990 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:22.546452 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:22.546722 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:22.565798 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] MFA Rules not processed for user `83657fa192a54fdc848106558d0816ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 12:11:22.572468 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:22.617951 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:22.631137 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1456/2909] 10.222.0.18 () {58 vars in 958 bytes} [Fri Aug 12 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 12:11:22.640825 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:22.642219 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:22.699626 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73671399-b378-462f-a0a3-42e2eeab0a9f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:22.703255 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a8a0dbe3ac0405c876c1a07f500bd7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64bceedd397d42d19ba79e9b3144c832', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:22.703857 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:22.704135 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:22.704410 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:22.713453 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:22.715051 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b14b-08e0-4aef-a933-4bb5112886f8 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:22.724791 dv-cinder-852828-2-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1454/2910] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Aug 12 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 12:11:23.122933 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 12:11:23.124448 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 12:11:23.136934 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da96c1-fbf8-4bba-8bff-c7c10d91f4b0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 12:11:23.142149 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83657fa192a54fdc848106558d0816ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65344c3d4d6c482091ff358a1b54d508', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 12:11:23.142858 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 12:11:23.143138 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 12:11:23.143412 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] PATH_INFO: `/v3/projects/8d9457356b5b4942b04c7d2224257198` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 12:11:23.144559 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9457356b5b4942b04c7d2224257198)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 12:11:23.146463 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 12:11:23.247811 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9457356b5b4942b04c7d2224257198', 'request_id': 'req-f677941e-aea6-4cff-bcb5-22437a6d70b7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:23.253752 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9457356b5b4942b04c7d2224257198', 'request_id': 'req-f677941e-aea6-4cff-bcb5-22437a6d70b7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:23.326954 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9457356b5b4942b04c7d2224257198', 'request_id': 'req-f677941e-aea6-4cff-bcb5-22437a6d70b7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:23.337556 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] The token cache is being invalidate because project 8d9457356b5b4942b04c7d2224257198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 12:11:23.337850 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:23.338499 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f677941e-aea6-4cff-bcb5-22437a6d70b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 12:11:23.340022 dv-cinder-852828-2-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1457/2911] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Aug 12 12:11:23 2022] DELETE /identity/v3/projects/8d9457356b5b4942b04c7d2224257198 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 12:11:32.720368 dv-cinder-852828-2-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=5,keystone:SELECT=40,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 12:11:33.334545 dv-cinder-852828-2-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}